Apr 24 19:09:36 devstack cinder-volume[72316]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:09:36 devstack cinder-volume[72316]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:09:36 devstack cinder-volume[72316]: we strongly recommend against using it for new projects. Apr 24 19:09:36 devstack cinder-volume[72316]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:09:36 devstack cinder-volume[72316]: framework. For more detail see Apr 24 19:09:36 devstack cinder-volume[72316]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:09:36 devstack cinder-volume[72316]: import eventlet # noqa Apr 24 19:09:38 devstack cinder-volume[72316]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:09:38 devstack cinder-volume[72316]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:09:38 devstack cinder-volume[72316]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:09:39 devstack cinder-volume[72316]: INFO dbcounter [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Registered counter for database cinder Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_db.sqlalchemy.engines [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG dbcounter [-] [72316] Writer thread running {{(pid=72316) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:09:39 devstack cinder-volume[72316]: INFO cinder.rpc [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:09:39 devstack cinder-volume[72316]: INFO cinder.rpc [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_db.sqlalchemy.engines [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:09:39 devstack cinder-volume[72316]: INFO cinder.volume.manager [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Determined volume DB was empty at startup. Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG cinder.volume.manager [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72316) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:09:39 devstack cinder-volume[72316]: INFO cinder.volume.manager [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 19:09:39 devstack cinder-volume[72316]: WARNING stevedore.named [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:09:39 devstack cinder-volume[72316]: WARNING castellan.key_manager [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:09:39 devstack cinder-volume[72316]: WARNING cinder.keymgr.conf_key_mgr [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG cinder.volume.drivers.lvm [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72316) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_concurrency.processutils [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_concurrency.processutils [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] CMD "cinder-rtstool verify" returned: 0 in 0.286s {{(pid=72316) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_db.sqlalchemy.engines [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:09:39 devstack cinder-volume[72316]: INFO cinder.rpc [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 24 19:09:39 devstack cinder-volume[72316]: INFO cinder.rpc [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 24 19:09:39 devstack cinder-volume[72316]: WARNING stevedore.named [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:09:39 devstack cinder-volume[72316]: WARNING castellan.key_manager [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:09:39 devstack cinder-volume[72316]: INFO cinder.volume.manager [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_db.sqlalchemy.engines [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:09:39 devstack cinder-volume[72316]: INFO oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Starting 1 workers Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Started child 72421 {{(pid=72316) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Full set of CONF: {{(pid=72316) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] ******************************************************************************** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Configuration options gathered from: {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:09:39 devstack cinder-volume[72421]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] ================================================================================ {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] allow_availability_zone_fallback = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] allow_compression_on_image_upload = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] allowed_direct_url_schemes = [] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] api_rate_limit = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] auth_strategy = keystone {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] az_cache_duration = 3600 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_availability_zone = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_host = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_name = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_stats_polling_interval = 60 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backup_api_class = cinder.backup.api.API {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backup_name_template = backup-%s {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backup_use_same_host = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backup_use_temp_snapshot = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] chap_password = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] chap_username = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cinder_internal_tenant_project_id = 6e61860adc6041beb0cc644bbf857f95 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cinder_internal_tenant_user_id = b6662bd25bf24be6a72fe4be512da72a {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cloned_volume_same_az = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cluster = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] compression_format = gzip {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] compute_api_class = cinder.compute.nova.API {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] config_dir = [] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] config_source = [] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] control_exchange = openstack {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] debug = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] default_availability_zone = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] default_group_type = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] default_volume_type = lvmdriver-1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] disk_geometry = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] driver_client_cert = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] driver_client_cert_key = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] driver_data_namespace = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] driver_ssl_cert_path = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] driver_ssl_cert_verify = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] driver_use_ssl = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] enable_force_upload = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] enable_new_services = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] enable_unsupported_driver = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] enforce_multipath_for_image_xfer = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] filter_function = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance_api_insecure = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance_api_servers = ['http://192.168.122.138/image'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance_api_ssl_compression = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance_ca_certificates_file = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance_catalog_info = image:glance:publicURL {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance_certfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance_keyfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance_num_retries = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance_request_timeout = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] goodness_function = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] graceful_shutdown_timeout = 5 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] group_api_class = cinder.group.api.API {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] host = devstack {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] image_compress_on_upload = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] image_conversion_address_space_limit = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] image_conversion_cpu_limit = 60 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] image_conversion_disable = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] image_upload_use_cinder_backend = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72421]: INFO cinder.volume.manager [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] image_upload_use_internal_tenant = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] image_volume_cache_enabled = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] image_volume_cache_max_count = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] image_volume_cache_max_size_gb = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] init_host_max_objects_retrieval = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] instance_format = [instance: %(uuid)s] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] iscsi_target_flags = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] iscsi_write_cache = on {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] iser_helper = tgtadm {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] iser_ip_address = 192.168.122.138 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] iser_port = 3260 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] log_color = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] log_config_append = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] log_dir = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] log_file = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] log_options = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] log_rotate_interval = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] log_rotate_interval_type = days {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] log_rotation_type = none {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] max_age = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] max_logfile_count = 30 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] max_logfile_size_mb = 200 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] max_over_subscription_ratio = 20.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] message_reap_interval = 86400 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] message_ttl = 2592000 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] migration_create_volume_timeout_secs = 300 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] monkey_patch = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] monkey_patch_modules = [] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] my_ip = 192.168.122.138 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] no_snapshot_gb_quota = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] num_iser_scan_tries = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] num_shell_tries = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] num_volume_device_scan_tries = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] nvmeof_conn_info_version = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] nvmet_ns_id = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] nvmet_port_id = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] osapi_max_limit = 1000 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] osapi_volume_ext_list = [] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] osapi_volume_listen_port = 8776 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] osapi_volume_use_ssl = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] osapi_volume_workers = 2 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] per_volume_size_limit = -1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] periodic_fuzzy_delay = 60 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] periodic_interval = 60 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] public_endpoint = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] publish_errors = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] quota_backup_gigabytes = 1000 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] quota_backups = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] quota_gigabytes = 1000 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] quota_groups = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] quota_snapshots = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] quota_volumes = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] rate_limit_burst = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] rate_limit_except_level = CRITICAL {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] rate_limit_interval = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] reinit_driver_count = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] replication_device = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] report_discard_supported = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] report_interval = 120 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] reservation_clean_interval = 86400 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] reservation_expire = 86400 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] reserved_image_namespaces = [] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] reserved_percentage = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] rpc_response_timeout = 120 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] run_external_periodic_tasks = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] scst_target_driver = iscsi {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] scst_target_iqn_name = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_down_time = 720 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] shell_completion = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] snapshot_name_template = snapshot-%s {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] snapshot_same_host = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] split_loggers = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] state_path = /opt/stack/data/cinder {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] storage_availability_zone = nova {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] storage_protocol = iSCSI {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] syslog_log_facility = LOG_USER {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] target_helper = lioadm {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] target_ip_address = 192.168.122.138 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] target_port = 3260 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] target_protocol = iscsi {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] target_secondary_ip_addresses = [] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] trace_flags = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] transport_url = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] until_refresh = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] use_chap_auth = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] use_default_quota_class = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] use_journal = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] use_json = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] use_multipath_for_image_xfer = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] use_stderr = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] use_syslog = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:39 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] verify_glance_signatures = enabled {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_api_class = cinder.volume.api.API {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_backend_name = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_clear = zero {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_clear_ionice = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_clear_size = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_copy_bps_limit = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_dd_blocksize = 1M {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_name_template = volume-%s {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_service_inithost_offload = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volume_usage_audit_period = month {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] zoning_mode = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_concurrency.disable_process_locking = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.admin_password = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.admin_token = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.admin_user = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.auth_port = 35357 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.auth_protocol = https {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.auth_section = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.auth_type = password {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.auth_uri = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.auth_version = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.cache = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.certfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.identity_uri = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.include_service_catalog = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.insecure = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.interface = public {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.keyfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_password = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcache_username = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.region_name = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.service_type = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.138/identity {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.backend = dogpile.cache.null {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.backend_argument = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.backend_expiration_time = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.config_prefix = cache.oslo {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.debug_cache_backend = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.enable_retry_client = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.enable_socket_keepalive = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.enabled = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.enforce_fips_mode = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.expiration_time = 600 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.hashclient_retry_attempts = 2 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.memcache_dead_retry = 300 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.memcache_pool_maxsize = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.memcache_sasl_enabled = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.password = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.proxies = [] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.redis_db = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.redis_server = localhost:6379 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.retry_attempts = 2 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.retry_delay = 0.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.socket_keepalive_count = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.socket_keepalive_idle = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.socket_keepalive_interval = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.socket_timeout = 1.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.tls_allowed_ciphers = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.tls_cafile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.tls_certfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.tls_enabled = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.tls_keyfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cache.username = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] coordination.backend_url = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.asyncio_connection = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.asyncio_slave_connection = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.backend = sqlalchemy {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.connection = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.connection_debug = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.connection_parameters = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.connection_recycle_time = 3600 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.connection_trace = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.db_inc_retry_interval = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.db_max_retries = 20 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.db_max_retry_interval = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.db_retry_interval = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.max_overflow = 50 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.max_pool_size = 5 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.max_retries = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.mysql_wsrep_sync_wait = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.pool_timeout = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.retry_interval = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.slave_connection = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.sqlite_synchronous = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.synchronous_reader = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] database.use_db_reconnect = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.connection_string = messaging:// {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.enabled = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.es_doc_type = notification {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.es_scroll_size = 10000 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.es_scroll_time = 2m {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.filter_error_trace = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.hmac_keys = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.sentinel_service_name = mymaster {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.socket_timeout = 0.1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.trace_requests = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler.trace_sqlalchemy = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler_jaeger.process_tags = {} {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler_jaeger.service_name_prefix = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] profiler_otlp.service_name_prefix = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.enforce_new_defaults = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:40 devstack cinder-volume[72316]: WARNING oslo_config.cfg [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.enforce_scope = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.policy_default_rule = default {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.policy_file = policy.yaml {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] privsep_osbrick.group = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] privsep_osbrick.helper_command = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] privsep_osbrick.user = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cinder_sys_admin.group = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cinder_sys_admin.helper_command = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] cinder_sys_admin.user = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_user.auth_section = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_user.auth_type = password {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_user.cafile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_user.certfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_user.collect_timing = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_user.insecure = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_user.keyfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_user.send_service_user_token = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_user.split_loggers = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] service_user.timeout = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance.auth_section = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance.auth_type = password {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance.certfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance.collect_timing = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance.insecure = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance.keyfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance.region_name = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance.split_loggers = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] glance.timeout = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.backend_availability_zone = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.chap_password = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.chap_username = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.disk_geometry = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.driver_client_cert = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.driver_client_cert_key = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.driver_data_namespace = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.driver_use_ssl = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.extra_capabilities = {} {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.filter_function = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.goodness_function = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.iscsi_target_flags = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.iscsi_write_cache = on {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.iser_helper = tgtadm {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.iser_ip_address = 192.168.122.138 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.iser_port = 3260 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.lvm_share_target = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.lvm_type = auto {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.num_shell_tries = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.replication_device = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.report_discard_supported = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.reserved_percentage = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.target_helper = tgtadm {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.target_ip_address = 192.168.122.138 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.target_port = 3260 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.target_protocol = iscsi {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.trace_flags = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.unique_fqdn_network = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.use_chap_auth = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.volume_backend_name = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.volume_clear = zero {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.volume_clear_ionice = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.volume_clear_size = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_reports.file_event_handler = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_reports.log_dir = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.backend_host = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.chap_password = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.chap_username = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.disk_geometry = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.driver_client_cert = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.extra_capabilities = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.filter_function = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.goodness_function = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.iser_helper = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.iser_ip_address = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.iser_port = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.lvm_share_target = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.lvm_type = auto {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.num_shell_tries = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.replication_device = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.report_discard_supported = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.reserved_percentage = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.scst_target_driver = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.storage_protocol = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.target_helper = lioadm {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.target_ip_address = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.target_port = 3260 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.trace_flags = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.use_chap_auth = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.volume_clear = zero {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.volume_clear_size = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] lvmdriver-1.volumes_dir = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.ssl = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_notifications.driver = [] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_notifications.retry = -1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] key_manager.fixed_key = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.barbican_api_version = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.barbican_endpoint = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.barbican_endpoint_type = public {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.barbican_region_name = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack sudo[72425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 24 19:09:40 devstack sudo[72425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.cafile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.certfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.collect_timing = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.insecure = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.keyfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.number_of_retries = 60 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.retry_delay = 1 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.send_service_user_token = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.split_loggers = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.timeout = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.verify_ssl = True {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican.verify_ssl_path = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican_service_user.auth_section = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican_service_user.auth_type = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican_service_user.cafile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican_service_user.certfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican_service_user.collect_timing = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican_service_user.insecure = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican_service_user.keyfile = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican_service_user.split_loggers = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] barbican_service_user.timeout = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.approle_role_id = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.approle_secret_id = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.kv_mountpoint = secret {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.kv_path = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.kv_version = 2 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.namespace = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.root_token_id = **** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.ssl_ca_crt_file = None {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.timeout = 60.0 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.use_ssl = False {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:09:40 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] ******************************************************************************** {{(pid=72316) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:09:40 devstack sudo[72425]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:40 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:40 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:40 devstack sudo[72499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:40 devstack sudo[72499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:41 devstack sudo[72499]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:41 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.548s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:41 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:09:41 devstack cinder-volume[72421]: INFO cinder.brick.local_dev.lvm [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 24 19:09:41 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:41 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:41 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:41 devstack sudo[72714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:09:41 devstack sudo[72714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:42 devstack sudo[72714]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:42 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:42 devstack cinder-volume[72421]: DEBUG cinder.brick.local_dev.lvm [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72421) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 24 19:09:42 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:42 devstack sudo[72906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:42 devstack sudo[72906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:43 devstack sudo[72906]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:43 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.254s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:43 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:43 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:43 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:43 devstack sudo[73068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:43 devstack sudo[73068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:43 devstack sudo[73068]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:43 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.546s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:43 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:43 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:43 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:43 devstack sudo[73125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 24 19:09:43 devstack sudo[73125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:44 devstack sudo[73125]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:44 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.507s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:44 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:44 devstack sudo[73128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:09:44 devstack sudo[73128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:44 devstack sudo[73128]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:44 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:44 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:44 devstack sudo[73133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:09:44 devstack sudo[73133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:45 devstack sudo[73133]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:45 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.526s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:45 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:45 devstack sudo[73137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:45 devstack sudo[73137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:45 devstack sudo[73137]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:45 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:45 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:45 devstack sudo[73145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:45 devstack sudo[73145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:46 devstack sudo[73145]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:46 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:46 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:46 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:46 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:46 devstack sudo[73149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:46 devstack sudo[73149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:46 devstack sudo[73149]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:46 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.517s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:46 devstack cinder-volume[72421]: INFO cinder.volume.drivers.lvm [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 24 19:09:46 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:47 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:47 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:47 devstack sudo[73159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:47 devstack sudo[73159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:47 devstack sudo[73159]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:47 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.670s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:47 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:09:47 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:47 devstack sudo[73273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:09:47 devstack sudo[73273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:48 devstack sudo[73273]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:48 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:48 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:48 devstack sudo[73416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:48 devstack sudo[73416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:48 devstack sudo[73416]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:48 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:48 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:48 devstack sudo[73419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:48 devstack sudo[73419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:49 devstack sudo[73419]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:49 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.546s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:49 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:49 devstack sudo[73422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:49 devstack sudo[73422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:49 devstack sudo[73422]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:49 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:49 devstack cinder-volume[72421]: INFO cinder.volume.driver [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:09:49 devstack cinder-volume[72421]: DEBUG cinder.volume.driver [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72421) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:09:49 devstack cinder-volume[72421]: DEBUG oslo_db.sqlalchemy.engines [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72421) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:09:49 devstack cinder-volume[72421]: DEBUG dbcounter [-] [72421] Writer thread running {{(pid=72421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:09:49 devstack cinder-volume[72421]: DEBUG cinder.db.sqlalchemy.api [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Building query based on filter {{(pid=72421) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:09:49 devstack cinder-volume[72421]: DEBUG cinder.image.image_utils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72421) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:09:49 devstack cinder-volume[72421]: INFO cinder.keymgr.migration [None req-aedeb3e9-8dad-4dc9-bc3a-370f176a4a42 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:09:49 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:09:49 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:49 devstack sudo[73428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:09:49 devstack sudo[73428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:49 devstack cinder-volume[72316]: DEBUG dbcounter [-] [72316] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72316) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:09:50 devstack sudo[73428]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:50 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.516s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:50 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:50 devstack sudo[73436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:50 devstack sudo[73436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:50 devstack sudo[73436]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:50 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:50 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:50 devstack sudo[73439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:50 devstack sudo[73439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:51 devstack sudo[73439]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:51 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.515s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:51 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:51 devstack sudo[73443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:51 devstack sudo[73443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:52 devstack sudo[73443]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:52 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:52 devstack cinder-volume[72421]: DEBUG cinder.manager [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Notifying Schedulers of capabilities ... {{(pid=72421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:09:52 devstack cinder-volume[72421]: INFO cinder.volume.manager [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Driver initialization completed successfully. Apr 24 19:09:52 devstack cinder-volume[72421]: INFO cinder.manager [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Initiating service 2 cleanup Apr 24 19:09:52 devstack cinder-volume[72421]: INFO cinder.manager [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Service 2 cleanup completed. Apr 24 19:09:52 devstack cinder-volume[72421]: DEBUG cinder.service [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Creating RPC server for service cinder-volume {{(pid=72421) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:09:52 devstack cinder-volume[72421]: DEBUG cinder.service [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72421) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:09:52 devstack cinder-volume[72421]: INFO cinder.volume.manager [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 24 19:09:52 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:09:52 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:52 devstack sudo[73446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:09:52 devstack sudo[73446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:52 devstack sudo[73446]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:52 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.549s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:52 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:52 devstack sudo[73453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:52 devstack sudo[73453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:53 devstack sudo[73453]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.572s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:53 devstack sudo[73456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:53 devstack sudo[73456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:53 devstack sudo[73456]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.510s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:53 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:53 devstack sudo[73513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:53 devstack sudo[73513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:54 devstack sudo[73513]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:54 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:54 devstack cinder-volume[72421]: INFO cinder.volume.manager [None req-2b08c278-c142-4ca9-94aa-0d64f46ee4d7 None None] Driver post RPC initialization completed successfully. Apr 24 19:10:02 devstack cinder-volume[72421]: DEBUG dbcounter [-] [72421] Writing DB stats cinder:SELECT=3 {{(pid=72421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:10:04 devstack cinder-volume[72421]: DEBUG dbcounter [-] [72421] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:11:00 devstack cinder-volume[72421]: DEBUG oslo_service.periodic_task [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:11:00 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:11:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:00 devstack sudo[78237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:11:00 devstack sudo[78237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:00 devstack sudo[78237]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:00 devstack sudo[78244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:11:00 devstack sudo[78244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:01 devstack sudo[78244]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:01 devstack sudo[78247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:11:01 devstack sudo[78247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:01 devstack sudo[78247]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:01 devstack sudo[78250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:11:01 devstack sudo[78250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:02 devstack sudo[78250]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:02 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:02 devstack cinder-volume[72421]: DEBUG cinder.manager [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Notifying Schedulers of capabilities ... {{(pid=72421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:12:00 devstack cinder-volume[72421]: DEBUG oslo_service.periodic_task [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:12:00 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:12:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:00 devstack sudo[78610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:12:00 devstack sudo[78610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:00 devstack sudo[78610]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.543s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:00 devstack sudo[78618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:12:00 devstack sudo[78618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:01 devstack sudo[78618]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.515s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:01 devstack sudo[78621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:12:01 devstack sudo[78621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:01 devstack sudo[78621]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.509s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:02 devstack sudo[78624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:12:02 devstack sudo[78624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:02 devstack sudo[78624]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:02 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:02 devstack cinder-volume[72421]: DEBUG cinder.manager [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Notifying Schedulers of capabilities ... {{(pid=72421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:12:04 devstack cinder-volume[72421]: DEBUG dbcounter [-] [72421] Writing DB stats cinder:SELECT=1 {{(pid=72421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:12:04 devstack cinder-volume[72421]: DEBUG dbcounter [-] [72421] Writing DB stats cinder:UPDATE=1 {{(pid=72421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:13:00 devstack cinder-volume[72421]: DEBUG oslo_service.periodic_task [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:13:00 devstack cinder-volume[72421]: DEBUG cinder.volume.drivers.lvm [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Updating volume stats {{(pid=72421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:13:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:00 devstack sudo[80618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:13:00 devstack sudo[80618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:00 devstack sudo[80618]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:00 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:00 devstack sudo[80633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:13:00 devstack sudo[80633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:01 devstack sudo[80633]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.562s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:01 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:01 devstack sudo[80638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:13:01 devstack sudo[80638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:02 devstack sudo[80638]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:02 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.539s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:02 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:02 devstack sudo[80641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:13:02 devstack sudo[80641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:02 devstack sudo[80641]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:02 devstack cinder-volume[72421]: DEBUG oslo_concurrency.processutils [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.537s {{(pid=72421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:02 devstack cinder-volume[72421]: DEBUG cinder.manager [None req-56a84df0-00df-48b1-86c9-d5e6c82ac914 None None] Notifying Schedulers of capabilities ... {{(pid=72421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:42 devstack cinder-volume[72316]: INFO oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Caught SIGTERM, stopping children Apr 24 19:13:42 devstack cinder-volume[72316]: DEBUG oslo_concurrency.lockutils [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Acquiring lock "singleton_lock" {{(pid=72316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:13:42 devstack cinder-volume[72316]: DEBUG oslo_concurrency.lockutils [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Acquired lock "singleton_lock" {{(pid=72316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:13:42 devstack cinder-volume[72316]: DEBUG oslo_concurrency.lockutils [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Releasing lock "singleton_lock" {{(pid=72316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:13:42 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Stop services. {{(pid=72316) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 19:13:42 devstack cinder-volume[72316]: DEBUG oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Killing children. {{(pid=72316) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 19:13:42 devstack cinder-volume[72316]: INFO oslo_service.backend._eventlet.service [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Waiting on 1 children to exit Apr 24 19:13:47 devstack cinder-volume[72421]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 24 19:13:47 devstack cinder-volume[72421]: DEBUG oslo_concurrency.lockutils [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Acquiring lock "singleton_lock" {{(pid=72421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:13:47 devstack cinder-volume[72421]: DEBUG oslo_concurrency.lockutils [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Acquired lock "singleton_lock" {{(pid=72421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:13:47 devstack cinder-volume[72421]: DEBUG oslo_concurrency.lockutils [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Releasing lock "singleton_lock" {{(pid=72421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:13:47 devstack cinder-volume[72421]: WARNING amqp [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:13:47 devstack cinder-volume[72421]: WARNING amqp [None req-0015a70e-9546-4e3f-b791-5a246ac91f20 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:13:47 devstack cinder-volume[81410]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:13:47 devstack cinder-volume[81410]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:13:47 devstack cinder-volume[81410]: we strongly recommend against using it for new projects. Apr 24 19:13:47 devstack cinder-volume[81410]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:13:47 devstack cinder-volume[81410]: framework. For more detail see Apr 24 19:13:47 devstack cinder-volume[81410]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:13:47 devstack cinder-volume[81410]: import eventlet # noqa Apr 24 19:13:49 devstack cinder-volume[81410]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81410) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:13:49 devstack cinder-volume[81410]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81410) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:13:49 devstack cinder-volume[81410]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81410) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:13:50 devstack cinder-volume[81410]: INFO dbcounter [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Registered counter for database cinder Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_db.sqlalchemy.engines [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG dbcounter [-] [81410] Writer thread running {{(pid=81410) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:13:50 devstack cinder-volume[81410]: INFO cinder.rpc [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:13:50 devstack cinder-volume[81410]: INFO cinder.rpc [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_db.sqlalchemy.engines [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:13:50 devstack cinder-volume[81410]: INFO cinder.volume.manager [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Determined volume DB was empty at startup. Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG cinder.volume.manager [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81410) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:13:50 devstack cinder-volume[81410]: INFO cinder.volume.manager [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 19:13:50 devstack cinder-volume[81410]: WARNING stevedore.named [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:13:50 devstack cinder-volume[81410]: WARNING castellan.key_manager [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:13:50 devstack cinder-volume[81410]: WARNING cinder.keymgr.conf_key_mgr [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:13:50 devstack cinder-volume[81410]: INFO cinder.volume.manager [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_db.sqlalchemy.engines [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:13:50 devstack cinder-volume[81410]: INFO oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Starting 1 workers Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Started child 81530 {{(pid=81410) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Full set of CONF: {{(pid=81410) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] ******************************************************************************** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Configuration options gathered from: {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:13:50 devstack cinder-volume[81530]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] ================================================================================ {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] allow_availability_zone_fallback = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] allow_compression_on_image_upload = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] allowed_direct_url_schemes = [] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] api_rate_limit = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] auth_strategy = keystone {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_availability_zone = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_host = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_name = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_stats_polling_interval = 60 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backup_api_class = cinder.backup.api.API {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backup_name_template = backup-%s {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backup_use_same_host = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backup_use_temp_snapshot = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] chap_password = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] chap_username = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cinder_internal_tenant_project_id = 6e61860adc6041beb0cc644bbf857f95 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cinder_internal_tenant_user_id = b6662bd25bf24be6a72fe4be512da72a {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cluster = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] compression_format = gzip {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] compute_api_class = cinder.compute.nova.API {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] config_dir = [] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] config_source = [] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] control_exchange = openstack {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] debug = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] default_availability_zone = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] default_group_type = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] default_volume_type = QuobyteHD {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] disk_geometry = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] driver_client_cert = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] driver_client_cert_key = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] driver_data_namespace = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] driver_ssl_cert_path = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] driver_ssl_cert_verify = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] driver_use_ssl = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] enable_new_services = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] enable_unsupported_driver = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] enabled_backends = ['QuobyteHD'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] enforce_multipath_for_image_xfer = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] filter_function = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance_api_insecure = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance_api_servers = ['http://192.168.122.138/image'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance_api_ssl_compression = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance_ca_certificates_file = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance_catalog_info = image:glance:publicURL {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance_certfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance_keyfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance_num_retries = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance_request_timeout = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] goodness_function = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] graceful_shutdown_timeout = 5 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81530]: INFO cinder.volume.manager [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] group_api_class = cinder.group.api.API {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81530]: DEBUG cinder.volume.drivers.remotefs [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81530) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] host = devstack {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] image_compress_on_upload = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] image_conversion_address_space_limit = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] image_conversion_cpu_limit = 60 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] image_conversion_disable = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] image_upload_use_cinder_backend = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] image_upload_use_internal_tenant = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] image_volume_cache_enabled = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] image_volume_cache_max_count = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] image_volume_cache_max_size_gb = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] init_host_max_objects_retrieval = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] instance_format = [instance: %(uuid)s] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] iscsi_target_flags = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] iscsi_write_cache = on {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] iser_helper = tgtadm {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] iser_ip_address = 192.168.122.138 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] iser_port = 3260 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] log_color = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] log_config_append = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] log_dir = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] log_file = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] log_options = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] log_rotate_interval = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] log_rotate_interval_type = days {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] log_rotation_type = none {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] max_age = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] max_logfile_count = 30 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] max_logfile_size_mb = 200 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] max_over_subscription_ratio = 20.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] message_reap_interval = 86400 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] message_ttl = 2592000 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] migration_create_volume_timeout_secs = 300 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] monkey_patch = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] monkey_patch_modules = [] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] my_ip = 192.168.122.138 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] no_snapshot_gb_quota = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] num_iser_scan_tries = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] num_shell_tries = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] num_volume_device_scan_tries = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] nvmeof_conn_info_version = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] nvmet_ns_id = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] nvmet_port_id = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] osapi_max_limit = 1000 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] osapi_volume_ext_list = [] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] osapi_volume_listen = 0.0.0.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] osapi_volume_listen_port = 8776 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] osapi_volume_use_ssl = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] osapi_volume_workers = 2 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] per_volume_size_limit = -1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] periodic_fuzzy_delay = 60 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] periodic_interval = 60 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] project_id_regex = [0-9a-f\-]+ {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] public_endpoint = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] publish_errors = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] quota_backup_gigabytes = 1000 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] quota_backups = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] quota_gigabytes = 1000 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] quota_groups = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] quota_snapshots = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] quota_volumes = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] rate_limit_burst = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] rate_limit_except_level = CRITICAL {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] rate_limit_interval = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] reinit_driver_count = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] replication_device = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] report_discard_supported = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] report_interval = 120 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] reservation_clean_interval = 86400 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] reservation_expire = 86400 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] reserved_image_namespaces = [] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] reserved_percentage = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] rpc_response_timeout = 120 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] run_external_periodic_tasks = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] scst_target_driver = iscsi {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] scst_target_iqn_name = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_down_time = 720 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] shell_completion = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] snapshot_name_template = snapshot-%s {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] split_loggers = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] state_path = /opt/stack/data/cinder {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] storage_availability_zone = nova {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] storage_protocol = iSCSI {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] syslog_log_facility = LOG_USER {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] target_helper = lioadm {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] target_ip_address = 192.168.122.138 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] target_port = 3260 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] target_protocol = iscsi {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] target_secondary_ip_addresses = [] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] trace_flags = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] transfer_api_class = cinder.transfer.api.API {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] transport_url = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] until_refresh = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] use_chap_auth = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] use_default_quota_class = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] use_journal = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] use_json = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] use_multipath_for_image_xfer = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] use_stderr = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] use_syslog = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] verify_glance_signatures = enabled {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_api_class = cinder.volume.api.API {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_backend_name = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_clear = zero {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_clear_ionice = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_clear_size = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_copy_bps_limit = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_dd_blocksize = 1M {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_name_template = volume-%s {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_service_inithost_offload = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volume_usage_audit_period = month {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] zoning_mode = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_concurrency.disable_process_locking = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.admin_password = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.admin_token = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.admin_user = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.auth_admin_prefix = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.auth_port = 35357 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.auth_protocol = https {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.auth_section = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.auth_type = password {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.auth_uri = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.auth_version = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.cache = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.certfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.delay_auth_decision = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.http_connect_timeout = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.identity_uri = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.include_service_catalog = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.insecure = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.interface = public {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.keyfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_password = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcache_username = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.region_name = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.service_token_roles_required = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.service_type = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81530]: DEBUG cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81530) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.token_cache_time = 300 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.138/identity {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.backend = dogpile.cache.null {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.backend_argument = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.backend_expiration_time = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.config_prefix = cache.oslo {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.debug_cache_backend = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.enable_retry_client = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.enable_socket_keepalive = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.enabled = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.enforce_fips_mode = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.expiration_time = 600 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81530]: WARNING cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81530]: WARNING cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.hashclient_retry_attempts = 2 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.memcache_dead_retry = 300 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.memcache_pool_maxsize = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Running cmd (subprocess): mount.quobyte {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.memcache_sasl_enabled = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.password = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.proxies = [] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.redis_db = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.redis_sentinel_service_name = mymaster {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.redis_server = localhost:6379 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.retry_attempts = 2 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.retry_delay = 0.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.socket_keepalive_count = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.socket_keepalive_idle = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.socket_keepalive_interval = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.socket_timeout = 1.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.tls_allowed_ciphers = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.tls_cafile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.tls_certfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.tls_enabled = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.tls_keyfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cache.username = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] coordination.backend_url = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.asyncio_connection = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.asyncio_slave_connection = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.backend = sqlalchemy {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.connection = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.connection_debug = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.connection_parameters = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.connection_recycle_time = 3600 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.connection_trace = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.db_inc_retry_interval = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.db_max_retries = 20 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.db_max_retry_interval = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.db_retry_interval = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.max_overflow = 50 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.max_pool_size = 5 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.max_retries = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.mysql_wsrep_sync_wait = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.pool_timeout = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.retry_interval = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.slave_connection = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.sqlite_synchronous = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.synchronous_reader = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] database.use_db_reconnect = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.connection_string = messaging:// {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.enabled = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.es_doc_type = notification {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.es_scroll_size = 10000 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.es_scroll_time = 2m {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.filter_error_trace = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.hmac_keys = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.sentinel_service_name = mymaster {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.socket_timeout = 0.1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.trace_requests = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler.trace_sqlalchemy = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler_jaeger.process_tags = {} {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler_jaeger.service_name_prefix = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] profiler_otlp.service_name_prefix = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.enforce_new_defaults = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: WARNING oslo_config.cfg [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.enforce_scope = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.policy_default_rule = default {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.policy_file = policy.yaml {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_policy.remote_timeout = 60.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] privsep_osbrick.group = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] privsep_osbrick.helper_command = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] privsep_osbrick.user = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cinder_sys_admin.group = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cinder_sys_admin.helper_command = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] cinder_sys_admin.user = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_user.auth_section = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_user.auth_type = password {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_user.cafile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_user.certfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_user.collect_timing = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_user.insecure = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_user.keyfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_user.send_service_user_token = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_user.split_loggers = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] service_user.timeout = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance.auth_section = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance.auth_type = password {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance.certfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance.collect_timing = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance.insecure = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance.keyfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance.region_name = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance.split_loggers = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] glance.timeout = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.backend_availability_zone = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.chap_password = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.chap_username = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.disk_geometry = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.driver_client_cert = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.driver_client_cert_key = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.driver_data_namespace = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.driver_use_ssl = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.enable_unsupported_driver = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.extra_capabilities = {} {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.filter_function = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.goodness_function = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.iscsi_target_flags = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.iscsi_write_cache = on {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.iser_helper = tgtadm {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.iser_ip_address = 192.168.122.138 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.iser_port = 3260 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nas_host = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nas_login = admin {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nas_mount_options = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nas_password = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nas_private_key = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nas_share_path = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nas_ssh_port = 22 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.num_shell_tries = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:50 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.nvmet_port_id = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.quobyte_client_cfg = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.quobyte_volume_url = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.replication_device = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.report_discard_supported = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.reserved_percentage = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.scst_target_driver = iscsi {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.scst_target_iqn_name = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.storage_protocol = iSCSI {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.target_helper = tgtadm {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.target_ip_address = 192.168.122.138 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.target_port = 3260 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.target_protocol = iscsi {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.trace_flags = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.unique_fqdn_network = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.use_chap_auth = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.volume_backend_name = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.volume_clear = zero {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.volume_clear_ionice = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.volume_clear_size = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_reports.file_event_handler = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_reports.log_dir = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.backend_availability_zone = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.backend_host = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.chap_password = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.chap_username = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.chiscsi_conf = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.disk_geometry = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.driver_client_cert = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.driver_client_cert_key = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.driver_data_namespace = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.driver_use_ssl = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.extra_capabilities = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.filter_function = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.goodness_function = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.iscsi_target_flags = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.iscsi_write_cache = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.iser_helper = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.iser_ip_address = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.iser_port = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.iser_target_prefix = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nas_host = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nas_login = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nas_mount_options = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nas_password = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nas_private_key = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nas_share_path = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nas_ssh_port = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.num_shell_tries = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nvmet_ns_id = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.nvmet_port_id = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.replication_device = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.report_discard_supported = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.reserved_percentage = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.scst_target_driver = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.storage_protocol = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack quobyte-client[81531]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 19:13:51 devstack quobyte-client[81531]: Invalid parameters found, error: missing mount point. Apr 24 19:13:51 devstack quobyte-client[81531]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 19:13:51 devstack quobyte-client[81531]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.target_helper = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.target_ip_address = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.target_port = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] CMD "mount.quobyte" returned: 1 in 0.139s {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.target_prefix = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.target_protocol = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:51 devstack cinder-volume[81530]: DEBUG cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.trace_flags = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.unique_fqdn_network = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81530]: INFO cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db ... Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.use_chap_auth = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 -c /etc/quobyte/client-cinder.cfg {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.volume_clear = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.volume_clear_ionice = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.volume_clear_size = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] QuobyteHD.volumes_dir = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack sudo[81532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 -c /etc/quobyte/client-cinder.cfg Apr 24 19:13:51 devstack sudo[81532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.ssl = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.ssl_version = {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_notifications.driver = [] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_notifications.retry = -1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] oslo_messaging_notifications.transport_url = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] key_manager.fixed_key = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.barbican_api_version = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.barbican_endpoint = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.barbican_endpoint_type = public {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.barbican_region_name = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.cafile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.certfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.collect_timing = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.insecure = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.keyfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.number_of_retries = 60 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.retry_delay = 1 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.send_service_user_token = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.split_loggers = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.timeout = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.verify_ssl = True {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican.verify_ssl_path = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican_service_user.auth_section = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican_service_user.auth_type = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican_service_user.cafile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican_service_user.certfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican_service_user.collect_timing = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican_service_user.insecure = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican_service_user.keyfile = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican_service_user.split_loggers = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] barbican_service_user.timeout = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.approle_role_id = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.approle_secret_id = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.kv_mountpoint = secret {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.kv_path = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.kv_version = 2 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.namespace = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.root_token_id = **** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.ssl_ca_crt_file = None {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.timeout = 60.0 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.use_ssl = False {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:13:51 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] ******************************************************************************** {{(pid=81410) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:13:51 devstack sudo[81532]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:51 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.691s {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:51 devstack cinder-volume[81530]: INFO cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db succeeded Apr 24 19:13:51 devstack cinder-volume[81530]: DEBUG cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:51 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.704s {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:51 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:51 devstack sudo[81601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:13:51 devstack sudo[81601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:52 devstack sudo[81601]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.518s {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:52 devstack cinder-volume[81530]: INFO cinder.volume.driver [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG cinder.volume.driver [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.688377380371, 'free_capacity_gb': 1775.688377380371, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81530) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG oslo_db.sqlalchemy.engines [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81530) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG dbcounter [-] [81530] Writer thread running {{(pid=81530) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG cinder.db.sqlalchemy.api [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Building query based on filter {{(pid=81530) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG cinder.image.image_utils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81530) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:13:52 devstack cinder-volume[81530]: INFO cinder.keymgr.migration [None req-1c8329fb-ffe2-4c66-a3cd-6b402f0012d6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:52 devstack sudo[81604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:13:52 devstack sudo[81604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:52 devstack sudo[81604]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.521s {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG cinder.manager [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Notifying Schedulers of capabilities ... {{(pid=81530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:52 devstack cinder-volume[81530]: INFO cinder.volume.manager [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Driver initialization completed successfully. Apr 24 19:13:52 devstack cinder-volume[81530]: INFO cinder.manager [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Initiating service 3 cleanup Apr 24 19:13:52 devstack cinder-volume[81530]: INFO cinder.manager [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Service 3 cleanup completed. Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG cinder.service [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Creating RPC server for service cinder-volume {{(pid=81530) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:13:52 devstack cinder-volume[81530]: DEBUG cinder.service [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81530) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:13:53 devstack cinder-volume[81530]: INFO cinder.volume.manager [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 19:13:53 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:53 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:53 devstack cinder-volume[81530]: DEBUG cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:53 devstack cinder-volume[81530]: DEBUG cinder.volume.drivers.quobyte [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:53 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:53 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:53 devstack sudo[81610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:13:53 devstack sudo[81610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:53 devstack sudo[81610]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:53 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.605s {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:53 devstack cinder-volume[81530]: INFO cinder.volume.manager [None req-eb175dd7-7e5c-49f8-8259-b9083d8b1b07 None None] Driver post RPC initialization completed successfully. Apr 24 19:13:56 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-3c0f5ea1-7b84-4eeb-8d56-080581ddf523 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:56 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-3c0f5ea1-7b84-4eeb-8d56-080581ddf523 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:56 devstack cinder-volume[81530]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f5ea1-7b84-4eeb-8d56-080581ddf523 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:56 devstack cinder-volume[81530]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f5ea1-7b84-4eeb-8d56-080581ddf523 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:56 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-3c0f5ea1-7b84-4eeb-8d56-080581ddf523 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81530) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:56 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-3c0f5ea1-7b84-4eeb-8d56-080581ddf523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:56 devstack sudo[81674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:13:56 devstack sudo[81674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:57 devstack sudo[81674]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:57 devstack cinder-volume[81530]: DEBUG oslo_concurrency.processutils [None req-3c0f5ea1-7b84-4eeb-8d56-080581ddf523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.538s {{(pid=81530) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:57 devstack cinder-volume[81530]: DEBUG cinder.manager [None req-3c0f5ea1-7b84-4eeb-8d56-080581ddf523 None None] Notifying Schedulers of capabilities ... {{(pid=81530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:58 devstack cinder-volume[81410]: INFO oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Caught SIGTERM, stopping children Apr 24 19:13:58 devstack cinder-volume[81410]: DEBUG oslo_concurrency.lockutils [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Acquiring lock "singleton_lock" {{(pid=81410) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:13:58 devstack cinder-volume[81410]: DEBUG oslo_concurrency.lockutils [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Acquired lock "singleton_lock" {{(pid=81410) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:13:58 devstack cinder-volume[81410]: DEBUG oslo_concurrency.lockutils [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Releasing lock "singleton_lock" {{(pid=81410) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:13:58 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Stop services. {{(pid=81410) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 19:13:58 devstack cinder-volume[81410]: DEBUG oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Killing children. {{(pid=81410) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 19:13:58 devstack cinder-volume[81410]: INFO oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Waiting on 1 children to exit Apr 24 19:14:01 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Acquiring lock "singleton_lock" {{(pid=81530) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:14:01 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Acquired lock "singleton_lock" {{(pid=81530) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:14:01 devstack cinder-volume[81530]: DEBUG oslo_concurrency.lockutils [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Releasing lock "singleton_lock" {{(pid=81530) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:14:01 devstack cinder-volume[81530]: WARNING amqp [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:14:01 devstack cinder-volume[81530]: WARNING amqp [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:14:01 devstack cinder-volume[81410]: INFO oslo_service.backend._eventlet.service [None req-52e88749-6f06-44a6-a59b-dadbe4a258fb None None] Child 81530 exited with status 0 Apr 24 19:14:01 devstack cinder-volume[81753]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:14:01 devstack cinder-volume[81753]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:14:01 devstack cinder-volume[81753]: we strongly recommend against using it for new projects. Apr 24 19:14:01 devstack cinder-volume[81753]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:14:01 devstack cinder-volume[81753]: framework. For more detail see Apr 24 19:14:01 devstack cinder-volume[81753]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:14:01 devstack cinder-volume[81753]: import eventlet # noqa Apr 24 19:14:04 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81753) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:14:04 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81753) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:14:04 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81753) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:14:05 devstack cinder-volume[81753]: INFO dbcounter [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Registered counter for database cinder Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_db.sqlalchemy.engines [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG dbcounter [-] [81753] Writer thread running {{(pid=81753) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:14:05 devstack cinder-volume[81753]: INFO cinder.rpc [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:14:05 devstack cinder-volume[81753]: INFO cinder.rpc [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_db.sqlalchemy.engines [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:14:05 devstack cinder-volume[81753]: INFO cinder.volume.manager [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Determined volume DB was empty at startup. Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG cinder.volume.manager [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81753) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:14:05 devstack cinder-volume[81753]: WARNING stevedore.named [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:14:05 devstack cinder-volume[81753]: WARNING castellan.key_manager [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:14:05 devstack cinder-volume[81753]: WARNING cinder.keymgr.conf_key_mgr [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:14:05 devstack cinder-volume[81753]: INFO cinder.volume.manager [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_db.sqlalchemy.engines [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:14:05 devstack cinder-volume[81753]: INFO oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Starting 1 workers Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Started child 81943 {{(pid=81753) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Full set of CONF: {{(pid=81753) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] ******************************************************************************** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Configuration options gathered from: {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] ================================================================================ {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] allow_availability_zone_fallback = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] allow_compression_on_image_upload = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] allowed_direct_url_schemes = [] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] api_rate_limit = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] auth_strategy = keystone {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_availability_zone = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_host = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_name = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_stats_polling_interval = 60 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backup_api_class = cinder.backup.api.API {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backup_name_template = backup-%s {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backup_use_same_host = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backup_use_temp_snapshot = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] chap_password = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] chap_username = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cinder_internal_tenant_project_id = 6e61860adc6041beb0cc644bbf857f95 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cinder_internal_tenant_user_id = b6662bd25bf24be6a72fe4be512da72a {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cluster = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] compression_format = gzip {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] compute_api_class = cinder.compute.nova.API {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] config_dir = [] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] config_source = [] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] control_exchange = openstack {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] debug = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] default_availability_zone = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] default_group_type = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] default_volume_type = QuobyteHD {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] disk_geometry = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] driver_client_cert = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] driver_client_cert_key = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] driver_data_namespace = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] driver_ssl_cert_path = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] driver_ssl_cert_verify = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] driver_use_ssl = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] enable_new_services = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] enable_unsupported_driver = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] enabled_backends = ['QuobyteHD'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] enforce_multipath_for_image_xfer = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] filter_function = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance_api_insecure = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance_api_servers = ['http://192.168.122.138/image'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance_api_ssl_compression = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance_ca_certificates_file = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance_catalog_info = image:glance:publicURL {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance_certfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance_keyfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance_num_retries = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance_request_timeout = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] goodness_function = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] graceful_shutdown_timeout = 5 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] group_api_class = cinder.group.api.API {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] host = devstack {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] image_compress_on_upload = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] image_conversion_address_space_limit = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] image_conversion_cpu_limit = 60 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] image_conversion_disable = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] image_upload_use_cinder_backend = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] image_upload_use_internal_tenant = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] image_volume_cache_enabled = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] image_volume_cache_max_count = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] image_volume_cache_max_size_gb = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] init_host_max_objects_retrieval = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] instance_format = [instance: %(uuid)s] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81943]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] iscsi_target_flags = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] iscsi_write_cache = on {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] iser_helper = tgtadm {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] iser_ip_address = 192.168.122.138 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] iser_port = 3260 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] log_color = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] log_config_append = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] log_dir = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] log_file = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] log_options = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] log_rotate_interval = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] log_rotate_interval_type = days {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] log_rotation_type = none {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] max_age = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] max_logfile_count = 30 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] max_logfile_size_mb = 200 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] max_over_subscription_ratio = 20.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] message_reap_interval = 86400 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] message_ttl = 2592000 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] migration_create_volume_timeout_secs = 300 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] monkey_patch = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] monkey_patch_modules = [] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] my_ip = 192.168.122.138 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] no_snapshot_gb_quota = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] num_iser_scan_tries = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] num_shell_tries = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] num_volume_device_scan_tries = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] nvmeof_conn_info_version = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] nvmet_ns_id = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] nvmet_port_id = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] osapi_max_limit = 1000 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] osapi_volume_ext_list = [] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] osapi_volume_listen = 0.0.0.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] osapi_volume_listen_port = 8776 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] osapi_volume_use_ssl = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] osapi_volume_workers = 2 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] per_volume_size_limit = -1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] periodic_fuzzy_delay = 60 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] periodic_interval = 60 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] project_id_regex = [0-9a-f\-]+ {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] public_endpoint = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] publish_errors = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] quota_backup_gigabytes = 1000 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] quota_backups = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] quota_gigabytes = 1000 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] quota_groups = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] quota_snapshots = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] quota_volumes = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] rate_limit_burst = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] rate_limit_except_level = CRITICAL {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack quobyte-client[81948]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] rate_limit_interval = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] reinit_driver_count = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] replication_device = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] report_discard_supported = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] report_interval = 120 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] reservation_clean_interval = 86400 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] reservation_expire = 86400 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack quobyte-client[81948]: Invalid parameters found, error: missing mount point. Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] reserved_image_namespaces = [] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] reserved_percentage = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] rpc_response_timeout = 120 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] run_external_periodic_tasks = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack quobyte-client[81948]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] scst_target_driver = iscsi {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] scst_target_iqn_name = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_down_time = 720 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] shell_completion = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] snapshot_name_template = snapshot-%s {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack quobyte-client[81948]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] split_loggers = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] state_path = /opt/stack/data/cinder {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] storage_availability_zone = nova {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] storage_protocol = iSCSI {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] syslog_log_facility = LOG_USER {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] target_helper = lioadm {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] target_ip_address = 192.168.122.138 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack sudo[81955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] target_port = 3260 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] target_protocol = iscsi {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] target_secondary_ip_addresses = [] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] trace_flags = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] transfer_api_class = cinder.transfer.api.API {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack sudo[81955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] transport_url = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] until_refresh = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] use_chap_auth = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] use_default_quota_class = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] use_journal = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] use_json = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] use_multipath_for_image_xfer = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] use_stderr = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] use_syslog = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] verify_glance_signatures = enabled {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_api_class = cinder.volume.api.API {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:05 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_backend_name = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_clear = zero {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_clear_ionice = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_clear_size = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_copy_bps_limit = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_dd_blocksize = 1M {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_name_template = volume-%s {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_service_inithost_offload = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volume_usage_audit_period = month {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] zoning_mode = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_concurrency.disable_process_locking = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.admin_password = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.admin_token = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.admin_user = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.auth_admin_prefix = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.auth_port = 35357 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.auth_protocol = https {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.auth_section = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.auth_type = password {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.auth_uri = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.auth_version = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.cache = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.certfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.delay_auth_decision = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.http_connect_timeout = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.identity_uri = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.include_service_catalog = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.insecure = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.interface = public {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.keyfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_password = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcache_username = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.region_name = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.service_token_roles_required = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.service_type = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.token_cache_time = 300 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.138/identity {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.backend = dogpile.cache.null {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.backend_argument = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.backend_expiration_time = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.config_prefix = cache.oslo {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.debug_cache_backend = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.enable_retry_client = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.enable_socket_keepalive = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.enabled = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.enforce_fips_mode = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.expiration_time = 600 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.hashclient_retry_attempts = 2 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.memcache_dead_retry = 300 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.memcache_pool_maxsize = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.memcache_sasl_enabled = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.password = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.proxies = [] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.redis_db = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.redis_sentinel_service_name = mymaster {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.redis_server = localhost:6379 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.retry_attempts = 2 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.retry_delay = 0.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.socket_keepalive_count = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.socket_keepalive_idle = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.socket_keepalive_interval = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.socket_timeout = 1.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.tls_allowed_ciphers = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.tls_cafile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.tls_certfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.tls_enabled = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.tls_keyfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cache.username = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] coordination.backend_url = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.asyncio_connection = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.asyncio_slave_connection = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.backend = sqlalchemy {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.connection = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.connection_debug = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.connection_parameters = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.connection_recycle_time = 3600 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.connection_trace = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.db_inc_retry_interval = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.db_max_retries = 20 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.db_max_retry_interval = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.db_retry_interval = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81943) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.max_overflow = 50 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.max_pool_size = 5 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.max_retries = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.mysql_wsrep_sync_wait = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.pool_timeout = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.retry_interval = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.slave_connection = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.sqlite_synchronous = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.synchronous_reader = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] database.use_db_reconnect = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.connection_string = messaging:// {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.enabled = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.es_doc_type = notification {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.es_scroll_size = 10000 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.es_scroll_time = 2m {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.filter_error_trace = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.hmac_keys = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.sentinel_service_name = mymaster {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.socket_timeout = 0.1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.trace_requests = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler.trace_sqlalchemy = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler_jaeger.process_tags = {} {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler_jaeger.service_name_prefix = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] profiler_otlp.service_name_prefix = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.enforce_new_defaults = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: WARNING oslo_config.cfg [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.enforce_scope = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.policy_default_rule = default {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.policy_file = policy.yaml {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_policy.remote_timeout = 60.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] privsep_osbrick.group = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] privsep_osbrick.helper_command = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] privsep_osbrick.user = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cinder_sys_admin.group = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cinder_sys_admin.helper_command = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] cinder_sys_admin.user = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_user.auth_section = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_user.auth_type = password {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_user.cafile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_user.certfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_user.collect_timing = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_user.insecure = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_user.keyfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_user.send_service_user_token = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_user.split_loggers = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] service_user.timeout = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance.auth_section = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance.auth_type = password {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance.certfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance.collect_timing = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance.insecure = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance.keyfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance.region_name = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance.split_loggers = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] glance.timeout = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.backend_availability_zone = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.chap_password = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.chap_username = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.disk_geometry = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.driver_client_cert = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.driver_client_cert_key = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.driver_data_namespace = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.driver_use_ssl = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.enable_unsupported_driver = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.extra_capabilities = {} {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.filter_function = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.goodness_function = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.iscsi_target_flags = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.iscsi_write_cache = on {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.iser_helper = tgtadm {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.iser_ip_address = 192.168.122.138 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.iser_port = 3260 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nas_host = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nas_login = admin {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nas_mount_options = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nas_password = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nas_private_key = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nas_share_path = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nas_ssh_port = 22 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.num_shell_tries = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.nvmet_port_id = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.quobyte_client_cfg = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.quobyte_volume_url = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.replication_device = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.report_discard_supported = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.reserved_percentage = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.scst_target_driver = iscsi {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.scst_target_iqn_name = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.storage_protocol = iSCSI {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.target_helper = tgtadm {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81943) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 19:14:06 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.quobyte [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.target_ip_address = 192.168.122.138 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.quobyte [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.target_port = 3260 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Running cmd (subprocess): mount.quobyte {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.target_protocol = iscsi {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.trace_flags = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.unique_fqdn_network = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.use_chap_auth = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.volume_backend_name = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.volume_clear = zero {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.volume_clear_ionice = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.volume_clear_size = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_reports.file_event_handler = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_reports.log_dir = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.backend_availability_zone = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.backend_host = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.chap_password = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.chap_username = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.chiscsi_conf = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.disk_geometry = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.driver_client_cert = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.driver_client_cert_key = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.driver_data_namespace = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.driver_use_ssl = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.extra_capabilities = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.filter_function = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.goodness_function = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.iscsi_target_flags = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.iscsi_write_cache = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.iser_helper = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.iser_ip_address = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.iser_port = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.iser_target_prefix = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nas_host = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nas_login = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nas_mount_options = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nas_password = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nas_private_key = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nas_share_path = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nas_ssh_port = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.num_shell_tries = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nvmet_ns_id = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.nvmet_port_id = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.replication_device = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.report_discard_supported = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.reserved_percentage = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.scst_target_driver = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.storage_protocol = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.target_helper = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.target_ip_address = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.target_port = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.target_prefix = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.target_protocol = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.trace_flags = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.unique_fqdn_network = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.use_chap_auth = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.volume_clear = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.volume_clear_ionice = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.volume_clear_size = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] QuobyteHD.volumes_dir = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.ssl = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.ssl_version = {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_notifications.driver = [] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_notifications.retry = -1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] oslo_messaging_notifications.transport_url = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] key_manager.fixed_key = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.barbican_api_version = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.barbican_endpoint = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.barbican_endpoint_type = public {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.barbican_region_name = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.cafile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.certfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.collect_timing = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.insecure = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.keyfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.number_of_retries = 60 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.retry_delay = 1 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.send_service_user_token = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.split_loggers = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.timeout = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.verify_ssl = True {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican.verify_ssl_path = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican_service_user.auth_section = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican_service_user.auth_type = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican_service_user.cafile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican_service_user.certfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican_service_user.collect_timing = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican_service_user.insecure = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican_service_user.keyfile = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican_service_user.split_loggers = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] barbican_service_user.timeout = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.approle_role_id = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.approle_secret_id = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.kv_mountpoint = secret {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.kv_path = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.kv_version = 2 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.namespace = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.root_token_id = **** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.ssl_ca_crt_file = None {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.timeout = 60.0 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.use_ssl = False {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:14:06 devstack cinder-volume[81753]: DEBUG oslo_service.backend._eventlet.service [None req-e43cabc9-9a17-4fd6-b4da-19a57df1041d None None] ******************************************************************************** {{(pid=81753) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:14:06 devstack sudo[81955]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.643s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:06 devstack cinder-volume[81943]: INFO cinder.volume.driver [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG cinder.volume.driver [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.688377380371, 'free_capacity_gb': 1775.688377380371, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81943) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_db.sqlalchemy.engines [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81943) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writer thread running {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG cinder.db.sqlalchemy.api [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Building query based on filter {{(pid=81943) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81943) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:06 devstack cinder-volume[81943]: INFO cinder.keymgr.migration [None req-cb7e9c09-3af2-4e7e-949c-de63ba109b88 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:14:06 devstack sudo[82019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:14:06 devstack sudo[82019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:07 devstack sudo[82019]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.553s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:07 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Driver initialization completed successfully. Apr 24 19:14:07 devstack cinder-volume[81943]: INFO cinder.manager [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Initiating service 3 cleanup Apr 24 19:14:07 devstack cinder-volume[81943]: INFO cinder.manager [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Service 3 cleanup completed. Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG cinder.service [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Creating RPC server for service cinder-volume {{(pid=81943) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG cinder.service [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81943) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:14:07 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:07 devstack sudo[82070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:14:07 devstack sudo[82070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:07 devstack sudo[82070]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.527s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:07 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-eb1d6d69-a130-42f4-8833-067d752003af None None] Driver post RPC initialization completed successfully. Apr 24 19:14:15 devstack cinder-volume[81753]: DEBUG dbcounter [-] [81753] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81753) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:14:17 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=2 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:14:17 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:14:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b8785f58-4fc0-4917-af79-a2836bd26158 tempest-BackendsCapabilitiesAdminTestsJSON-1936565180 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.688377380371, 'free_capacity_gb': 1775.688377380371, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81943) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 19:14:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ee8f125-3292-48f6-aa16-16bfd9b5df47 tempest-BackendsCapabilitiesAdminTestsJSON-1936565180 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.688377380371, 'free_capacity_gb': 1775.688377380371, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81943) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 19:15:06 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-515c3578-36af-4204-955d-5c0e02e2be0c tempest-GroupSnapshotsTest-33851634 None] Group tempest-GroupSnapshotsTest-Group-887218230: creating Apr 24 19:15:06 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-515c3578-36af-4204-955d-5c0e02e2be0c tempest-GroupSnapshotsTest-33851634 None] Group tempest-GroupSnapshotsTest-Group-887218230: created successfully Apr 24 19:15:06 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-515c3578-36af-4204-955d-5c0e02e2be0c tempest-GroupSnapshotsTest-33851634 None] Create group completed successfully. Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Flow 'volume_create_manager' (8ebd682f-0200-4f7d-ac69-e5fc3697e231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92f4c97-29a1-459a-9c15-7ddf88347275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92f4c97-29a1-459a-9c15-7ddf88347275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-918313985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1fec4f0-e773-4f8b-9af0-975150c301e1,host='devstack@QuobyteHD#QuobyteHD',id=cbc911bf-f339-44a9-b7ac-bce3d57ca7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b721c1090eda4b48bf7dd75613a6ed62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:07Z,use_quota=True,user_id='df9cd0eb7c234a6fac3e5bc6257ce0d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f2d630d-d229-4021-8129-de3f9655571c),volume_type_id=3f2d630d-d229-4021-8129-de3f9655571c)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e052a8a8-f109-44ce-9b1f-cfcae43e66ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e052a8a8-f109-44ce-9b1f-cfcae43e66ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688f1af6-004c-4b97-8f6d-0af1e8007ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688f1af6-004c-4b97-8f6d-0af1e8007ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc911bf-f339-44a9-b7ac-bce3d57ca7d2', 'volume_name': 'volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2294a22-a98f-429c-bc04-6794b24b9f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2294a22-a98f-429c-bc04-6794b24b9f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3bdc23-a7b6-4cce-9921-8b1bb517f029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:07 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Volume cbc911bf-f339-44a9-b7ac-bce3d57ca7d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2', 'volume_size': 1} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1fec4f0-e773-4f8b-9af0-975150c301e1,created_at=2026-04-24T17:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-918313985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1fec4f0-e773-4f8b-9af0-975150c301e1,host='devstack@QuobyteHD#QuobyteHD',id=cbc911bf-f339-44a9-b7ac-bce3d57ca7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b721c1090eda4b48bf7dd75613a6ed62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:07Z,use_quota=True,user_id='df9cd0eb7c234a6fac3e5bc6257ce0d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f2d630d-d229-4021-8129-de3f9655571c),volume_type_id=3f2d630d-d229-4021-8129-de3f9655571c)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Creating volume cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:07 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:15:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:07 devstack sudo[82284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 1073741824 Apr 24 19:15:07 devstack sudo[82284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:08 devstack sudo[82284]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 1073741824" returned: 0 in 0.990s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:08 devstack sudo[82603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 Apr 24 19:15:08 devstack sudo[82603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:09 devstack sudo[82603]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" returned: 0 in 0.581s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3bdc23-a7b6-4cce-9921-8b1bb517f029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4298c5-a522-4dc5-b821-599cff0228e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:09 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Volume volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 (cbc911bf-f339-44a9-b7ac-bce3d57ca7d2): created successfully Apr 24 19:15:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4298c5-a522-4dc5-b821-599cff0228e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Flow 'volume_create_manager' (8ebd682f-0200-4f7d-ac69-e5fc3697e231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:09 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5dcf93ab-82f1-4e23-b0c6-88b43c737092 tempest-GroupSnapshotsTest-33851634 None] Created volume successfully. Apr 24 19:15:10 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] GroupSnapshot 5fe1de0d-c9de-4dc8-8a63-3a0188fa8096: creating. Apr 24 19:15:10 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Group snapshot 5fe1de0d-c9de-4dc8-8a63-3a0188fa8096: creating. {{(pid=81943) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:15:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Creating offline snapshot 39e4ae50-e443-40a1-b50d-8b0daaa3dd68 of volume cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:15:10 devstack cinder-volume[81943]: INFO oslo.privsep.daemon [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpc5_1lw93/privsep.sock'] Apr 24 19:15:10 devstack sudo[82607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpc5_1lw93/privsep.sock Apr 24 19:15:10 devstack sudo[82607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:15:11 devstack cinder-volume[81943]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 24 19:15:12 devstack sudo[82607]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:12 devstack cinder-volume[81943]: INFO oslo.privsep.daemon [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Spawned new privsep daemon via rootwrap Apr 24 19:15:12 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Accepted privsep connection to /tmp/tmpc5_1lw93/privsep.sock {{(pid=81943) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 24 19:15:12 devstack cinder-volume[81943]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 24 19:15:12 devstack cinder-volume[81943]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 24 19:15:12 devstack cinder-volume[81943]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 24 19:15:12 devstack cinder-volume[81943]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82613 Apr 24 19:15:12 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c966d97-95d1-4124-ab53-08d221c3263e]: (2,) {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:12 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eb14b5-86f9-40d4-8374-6833c691218c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:12 devstack sudo[82615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 Apr 24 19:15:12 devstack sudo[82615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:13 devstack sudo[82615]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" returned: 0 in 1.016s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:13 devstack sudo[82625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 1G Apr 24 19:15:13 devstack sudo[82625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:14 devstack sudo[82625]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 1G" returned: 0 in 1.010s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:14 devstack sudo[82631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 Apr 24 19:15:14 devstack sudo[82631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:15 devstack sudo[82631]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68" returned: 0 in 0.872s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:15 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:15:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:15 devstack sudo[82643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 Apr 24 19:15:15 devstack sudo[82643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:15 devstack sudo[82643]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68" returned: 0 in 0.633s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:15 devstack sudo[82647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.info Apr 24 19:15:15 devstack sudo[82647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:16 devstack sudo[82647]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.info" returned: 0 in 0.691s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:16 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:15:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:16 devstack sudo[82653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.info Apr 24 19:15:16 devstack sudo[82653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:17 devstack sudo[82653]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.info" returned: 0 in 0.891s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:17 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-6777bb92-424f-4d8f-8e69-be6d5735404a tempest-GroupSnapshotsTest-33851634 None] group_snapshot 5fe1de0d-c9de-4dc8-8a63-3a0188fa8096: created successfully Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-39e4ae50-e443-40a1-b50d-8b0daaa3dd68-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" by "_create_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-39e4ae50-e443-40a1-b50d-8b0daaa3dd68-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Creating volume 4d213a8b-327b-4030-91a9-7a5bb55bbb5e from snapshot 39e4ae50-e443-40a1-b50d-8b0daaa3dd68 {{(pid=81943) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] snapshot: 39e4ae50-e443-40a1-b50d-8b0daaa3dd68, volume: 4d213a8b-327b-4030-91a9-7a5bb55bbb5e, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:15:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:20 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee97f3a-a25f-47b3-94b5-7ee07f32293c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:20 devstack sudo[82738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 Apr 24 19:15:20 devstack sudo[82738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:21 devstack sudo[82738]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68" returned: 0 in 1.135s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:15:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:15:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:15:21 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaef3f3-e51b-4c0f-a1dc-776f0b2a0eb6]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:21 devstack sudo[82751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 Apr 24 19:15:21 devstack sudo[82751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:22 devstack sudo[82751]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" returned: 0 in 1.035s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:22 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:15:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:22 devstack sudo[82763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e Apr 24 19:15:22 devstack sudo[82763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:29 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:DELETE=1,cinder:INSERT=1 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:15:29 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:15:33 devstack sudo[82763]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" returned: 0 in 10.763s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:33 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a20afe6-ff37-4ced-b838-8780295773a8]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:33 devstack sudo[82837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 Apr 24 19:15:33 devstack sudo[82837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:34 devstack sudo[82837]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" returned: 0 in 1.308s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:34 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2, size 1024.00 MB, duration 10.77 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:15:34 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Converted 1024.00 MB image at 95.12 MB/s Apr 24 19:15:34 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:15:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:34 devstack sudo[82899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e Apr 24 19:15:34 devstack sudo[82899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:35 devstack sudo[82899]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" returned: 0 in 0.761s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" released by "_copy_volume_from_snapshot" :: held 15.329s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-39e4ae50-e443-40a1-b50d-8b0daaa3dd68-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" released by "_create_volume_from_snapshot" :: held 15.390s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.433s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:35 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-ba57be8e-6640-4c78-bcd9-7209513768b1 tempest-GroupSnapshotsTest-33851634 None] Create group from source-snapshot-5fe1de0d-c9de-4dc8-8a63-3a0188fa8096 completed successfully. Apr 24 19:15:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" acquired by "delete_volume" :: waited 0.037s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:36 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07b6ca0-6ab8-4d73-af8d-43591a29dde7]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:36 devstack sudo[82916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e Apr 24 19:15:36 devstack sudo[82916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:36 devstack sudo[82916]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" returned: 0 in 0.759s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:36 devstack sudo[82923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e Apr 24 19:15:36 devstack sudo[82923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:37 devstack sudo[82923]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" returned: 0 in 0.676s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-4d213a8b-327b-4030-91a9-7a5bb55bbb5e" released by "delete_volume" :: held 1.493s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:37 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Created reservations ['4db79632-ddcb-4d39-ad83-e05e55175af4'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:37 devstack cinder-volume[81943]: WARNING cinder.quota [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2107632037 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2107632037, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:37 devstack cinder-volume[81943]: WARNING cinder.quota [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2107632037 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2107632037, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:37 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Created reservations ['5bf2ceed-7fa6-439c-a039-a8f1d3955f3b', 'a62fa811-05a3-4261-b417-c4f4bf95fc0d', 'fc37ed1d-d020-487d-ad61-190c8af6abfe', 'c4045edd-bbe8-4e91-a7c2-a5ccf5bf543a'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:38 devstack sudo[82931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:15:38 devstack sudo[82931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:38 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] group_snapshot 5fe1de0d-c9de-4dc8-8a63-3a0188fa8096: deleting Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] group_snapshot 5fe1de0d-c9de-4dc8-8a63-3a0188fa8096: deleting {{(pid=81943) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-39e4ae50-e443-40a1-b50d-8b0daaa3dd68" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-39e4ae50-e443-40a1-b50d-8b0daaa3dd68" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Deleting offline snapshot 39e4ae50-e443-40a1-b50d-8b0daaa3dd68 of volume cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] snapshot_file for this snap is: volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66df06c-c8af-4f11-979d-3d731cdcc631]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:39 devstack sudo[82938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 Apr 24 19:15:39 devstack sudo[82938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:39 devstack sudo[82931]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.236s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:39 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:39 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d8acd7ab-0f75-41fd-92b1-9b9e56ee25e2 tempest-GroupSnapshotsTest-33851634 None] Delete group completed successfully. Apr 24 19:15:39 devstack sudo[82938]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68" returned: 0 in 0.889s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:15:39 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee43270e-adc9-4448-8ef7-bba89c1ee142]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:39 devstack sudo[82957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 Apr 24 19:15:39 devstack sudo[82957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:40 devstack sudo[82957]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" returned: 0 in 0.849s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:40 devstack sudo[82991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 Apr 24 19:15:40 devstack sudo[82991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:15:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:40 devstack sudo[82995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:15:40 devstack sudo[82995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:41 devstack sudo[82991]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68" returned: 0 in 1.328s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:42 devstack sudo[83011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68 Apr 24 19:15:42 devstack sudo[83011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:42 devstack sudo[82995]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.243s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:43 devstack sudo[83011]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2.39e4ae50-e443-40a1-b50d-8b0daaa3dd68" returned: 0 in 1.127s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-39e4ae50-e443-40a1-b50d-8b0daaa3dd68" released by "_delete_snapshot" :: held 4.470s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" released by "delete_snapshot" :: held 4.532s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:43 devstack cinder-volume[81943]: WARNING cinder.quota [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2107632037 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2107632037, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:43 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] Created reservations ['be5f3cd4-1a7c-4d66-b90b-10cca85057cc', '834e353b-aa3b-424f-aad9-0c14415db9b0', 'e78e1eac-37fe-4cbb-895d-bae634b71185', '7d3744b5-4b4a-4f9d-bdba-a8bb6040c04f'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:43 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-8665c784-1e98-4c67-9671-b9259e7fa616 tempest-GroupSnapshotsTest-33851634 None] group_snapshot 5fe1de0d-c9de-4dc8-8a63-3a0188fa8096: deleted successfully Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Flow 'volume_create_manager' (18fa9948-9f5a-4a0c-96c2-fdd20bc5a386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c27d8e-e24c-4db7-9129-50945a4f0736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c27d8e-e24c-4db7-9129-50945a4f0736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-950262828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e6d9bc-1748-4328-9733-8571eddfba42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31bd6ccd6b44d49ad12a3a87b4d789c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:45Z,use_quota=True,user_id='e5813a4965c74a8f9c92e29f52658672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b7922f-7094-42f2-85d5-61736b38d954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b7922f-7094-42f2-85d5-61736b38d954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c348b2-c055-41ae-94e8-17b475b5ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c348b2-c055-41ae-94e8-17b475b5ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e6d9bc-1748-4328-9733-8571eddfba42', 'volume_name': 'volume-06e6d9bc-1748-4328-9733-8571eddfba42', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8bf55d-4c84-42e5-8ddf-82a6ce5048fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8bf55d-4c84-42e5-8ddf-82a6ce5048fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c24a2c3-e9c6-4312-9ba5-8587ab579c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:44 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Volume 06e6d9bc-1748-4328-9733-8571eddfba42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e6d9bc-1748-4328-9733-8571eddfba42', 'volume_size': 1} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-950262828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e6d9bc-1748-4328-9733-8571eddfba42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31bd6ccd6b44d49ad12a3a87b4d789c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:45Z,use_quota=True,user_id='e5813a4965c74a8f9c92e29f52658672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Creating volume 06e6d9bc-1748-4328-9733-8571eddfba42 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:44 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:15:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:44 devstack sudo[83025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42 1073741824 Apr 24 19:15:44 devstack sudo[83025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" acquired by "delete_volume" :: waited 0.032s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:45 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc6e4d6-36b1-4d67-872a-7a261e64e3cb]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:45 devstack sudo[83027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 Apr 24 19:15:45 devstack sudo[83027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:46 devstack sudo[83025]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42 1073741824" returned: 0 in 1.168s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:46 devstack sudo[83027]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" returned: 0 in 1.002s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:46 devstack sudo[83035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42 Apr 24 19:15:46 devstack sudo[83035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:46 devstack sudo[83036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2 Apr 24 19:15:46 devstack sudo[83036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:46 devstack sudo[83036]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" returned: 0 in 0.772s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:46 devstack sudo[83035]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-cbc911bf-f339-44a9-b7ac-bce3d57ca7d2" released by "delete_volume" :: held 1.851s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42" returned: 0 in 0.855s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Created reservations ['7cb1acd3-31ba-4b1f-ae6f-85c6363c4149'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c24a2c3-e9c6-4312-9ba5-8587ab579c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e6d9bc-1748-4328-9733-8571eddfba42', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a82f75-2d86-4ef1-8bb5-40965775d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:47 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Volume volume-06e6d9bc-1748-4328-9733-8571eddfba42 (06e6d9bc-1748-4328-9733-8571eddfba42): created successfully Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a82f75-2d86-4ef1-8bb5-40965775d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Flow 'volume_create_manager' (18fa9948-9f5a-4a0c-96c2-fdd20bc5a386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:47 devstack cinder-volume[81943]: WARNING cinder.db.sqlalchemy.api [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2107632037'] Apr 24 19:15:47 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c2390bb6-5193-4dca-a168-20388e7dbfd4 tempest-VolumesAdminNegativeTest-720366741 None] Created volume successfully. Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Created reservations ['c5f51076-d33e-4621-b038-c8a749dd78ba', '8d675e18-f742-42fa-ae28-24cd1aa4bc2d', 'f87453a8-1df3-434b-9d54-b91c9226a393', 'b85286d0-388e-42f1-94c6-911b1457b7ee'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:47 devstack sudo[83042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:15:47 devstack sudo[83042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:48 devstack sudo[83042]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.752s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:48 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:48 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-90e808b5-e49f-499e-92fc-8bad416abcaf tempest-GroupSnapshotsTest-33851634 None] Delete group completed successfully. Apr 24 19:15:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Acquiring lock "cinder-06e6d9bc-1748-4328-9733-8571eddfba42-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Lock "cinder-06e6d9bc-1748-4328-9733-8571eddfba42-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Acquiring lock "cinder-quobyte-06e6d9bc-1748-4328-9733-8571eddfba42" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Lock "cinder-quobyte-06e6d9bc-1748-4328-9733-8571eddfba42" acquired by "delete_volume" :: waited 0.031s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:49 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b31a8c-5d69-4196-8617-d5599c865ad0]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:49 devstack sudo[83045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42 Apr 24 19:15:49 devstack sudo[83045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-69d2bce9-ab56-439a-a5e1-9f5e6244f098 tempest-GroupSnapshotsTest-33851634 None] Group tempest-GroupSnapshotsTest-Group-1327369752: creating Apr 24 19:15:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-69d2bce9-ab56-439a-a5e1-9f5e6244f098 tempest-GroupSnapshotsTest-33851634 None] Group tempest-GroupSnapshotsTest-Group-1327369752: created successfully Apr 24 19:15:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-69d2bce9-ab56-439a-a5e1-9f5e6244f098 tempest-GroupSnapshotsTest-33851634 None] Create group completed successfully. Apr 24 19:15:50 devstack sudo[83045]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42" returned: 0 in 1.146s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:50 devstack sudo[83052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42 Apr 24 19:15:50 devstack sudo[83052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:51 devstack sudo[83052]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-06e6d9bc-1748-4328-9733-8571eddfba42" returned: 0 in 1.122s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Lock "cinder-quobyte-06e6d9bc-1748-4328-9733-8571eddfba42" released by "delete_volume" :: held 2.326s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:51 devstack cinder-volume[81943]: WARNING cinder.quota [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:51 devstack cinder-volume[81943]: WARNING cinder.quota [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Created reservations ['334c40c0-7395-4ab4-9eb6-5f4bdf18db99', '6e59657f-be02-446f-b0cb-d27dcf52168b', '0ef3920c-2c42-483a-b620-5e6e183bcf3d', '2efbdb7b-2fe8-45ee-91df-7310fdbceba8'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:51 devstack sudo[83056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:15:51 devstack sudo[83056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Flow 'volume_create_manager' (1bd3fe1d-6a6c-4c1d-bb60-ec695adf89b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f598979e-18ad-4cb0-b0f6-d688a864682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f598979e-18ad-4cb0-b0f6-d688a864682e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-154488404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23a3fb5b-7fb9-42f8-91f5-28a8ed987b04,host='devstack@QuobyteHD#QuobyteHD',id=bd8b2f36-8c61-4094-9330-f8f5a38eec3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b721c1090eda4b48bf7dd75613a6ed62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:52Z,use_quota=True,user_id='df9cd0eb7c234a6fac3e5bc6257ce0d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d0b279a-1fad-43b9-864a-d58d58d8b069),volume_type_id=2d0b279a-1fad-43b9-864a-d58d58d8b069)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af1acd9-3b79-4de5-9da4-51715c5a88bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af1acd9-3b79-4de5-9da4-51715c5a88bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b497eb4-4627-4b4d-8cd5-47659e0d6777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b497eb4-4627-4b4d-8cd5-47659e0d6777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd8b2f36-8c61-4094-9330-f8f5a38eec3e', 'volume_name': 'volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65dcc1d0-d918-4d64-8414-a45b05f64ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65dcc1d0-d918-4d64-8414-a45b05f64ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb370b4-d397-46bd-87e6-eb47268d3c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Volume bd8b2f36-8c61-4094-9330-f8f5a38eec3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e', 'volume_size': 1} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23a3fb5b-7fb9-42f8-91f5-28a8ed987b04,created_at=2026-04-24T17:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-154488404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23a3fb5b-7fb9-42f8-91f5-28a8ed987b04,host='devstack@QuobyteHD#QuobyteHD',id=bd8b2f36-8c61-4094-9330-f8f5a38eec3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b721c1090eda4b48bf7dd75613a6ed62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:52Z,use_quota=True,user_id='df9cd0eb7c234a6fac3e5bc6257ce0d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d0b279a-1fad-43b9-864a-d58d58d8b069),volume_type_id=2d0b279a-1fad-43b9-864a-d58d58d8b069)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Creating volume bd8b2f36-8c61-4094-9330-f8f5a38eec3e {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:52 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:52 devstack sudo[83058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e 1073741824 Apr 24 19:15:52 devstack sudo[83058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Flow 'volume_create_manager' (0af1969e-18b9-4149-80d9-0b69fdc29ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaec8684-25b4-480f-9770-82d7b61a9919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaec8684-25b4-480f-9770-82d7b61a9919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:51Z,deleted=False,deleted_at=None,display_description='',display_name='47d21215-44c0-430e-a417-c7e89d97e01c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8799876b-df2c-427e-a9c1-852a3c89a9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511e39e762144655ad58a26fe4fc9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:52Z,use_quota=True,user_id='274a8b3ced9b4c8da93c060403ee1dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d384d5ef-f948-4104-b4bb-75bb2b42bf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d384d5ef-f948-4104-b4bb-75bb2b42bf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae85b45-e485-468a-8976-314bc01d61e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae85b45-e485-468a-8976-314bc01d61e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8799876b-df2c-427e-a9c1-852a3c89a9e6', 'volume_name': 'volume-8799876b-df2c-427e-a9c1-852a3c89a9e6', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1600ac-598f-4eac-ab6c-4015235b29a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1600ac-598f-4eac-ab6c-4015235b29a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b8326b-37e1-4667-b83c-acfc0fa96689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Volume 8799876b-df2c-427e-a9c1-852a3c89a9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8799876b-df2c-427e-a9c1-852a3c89a9e6', 'volume_size': 1} Apr 24 19:15:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:53 devstack sudo[83056]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.382s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:53 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:53 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Deleted volume successfully. Apr 24 19:15:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1fa28a5-dd87-495b-af25-069b34cf93e0 tempest-VolumesAdminNegativeTest-720366741 None] Lock "cinder-06e6d9bc-1748-4328-9733-8571eddfba42-delete_volume" released by "delete_volume" :: held 4.375s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:53 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-219b8be0-484b-4415-ab5d-2afd01c78498 tempest-GroupsV320Test-624155037 None] Group tempest-GroupsV320Test-Group-437553519: creating Apr 24 19:15:53 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-219b8be0-484b-4415-ab5d-2afd01c78498 tempest-GroupsV320Test-624155037 None] Group tempest-GroupsV320Test-Group-437553519: created successfully Apr 24 19:15:53 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-219b8be0-484b-4415-ab5d-2afd01c78498 tempest-GroupsV320Test-624155037 None] Create group completed successfully. Apr 24 19:15:53 devstack sudo[83058]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e 1073741824" returned: 0 in 1.820s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:54 devstack sudo[83089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e Apr 24 19:15:54 devstack sudo[83089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:54 devstack sudo[83089]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" returned: 0 in 0.713s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] <== create_volume: return (2649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.653s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.159s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:51Z,deleted=False,deleted_at=None,display_description='',display_name='47d21215-44c0-430e-a417-c7e89d97e01c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8799876b-df2c-427e-a9c1-852a3c89a9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511e39e762144655ad58a26fe4fc9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:52Z,use_quota=True,user_id='274a8b3ced9b4c8da93c060403ee1dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Creating volume 8799876b-df2c-427e-a9c1-852a3c89a9e6 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:54 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb370b4-d397-46bd-87e6-eb47268d3c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:54 devstack sudo[83095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 1073741824 Apr 24 19:15:54 devstack sudo[83095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f93c7da-3433-4c4a-a5b5-765ba56aa15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:54 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Volume volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e (bd8b2f36-8c61-4094-9330-f8f5a38eec3e): created successfully Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f93c7da-3433-4c4a-a5b5-765ba56aa15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Flow 'volume_create_manager' (1bd3fe1d-6a6c-4c1d-bb60-ec695adf89b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:54 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d5a2d118-bb83-484e-977b-b97cd2284380 tempest-GroupSnapshotsTest-33851634 None] Created volume successfully. Apr 24 19:15:55 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-46f5d0c5-2311-4a84-aa7b-ad017c0ac1e6 tempest-GroupsV320Test-624155037 None] Created reservations ['bcf44675-52df-4cbe-8e12-ab449c267685'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-46f5d0c5-2311-4a84-aa7b-ad017c0ac1e6 tempest-GroupsV320Test-624155037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-46f5d0c5-2311-4a84-aa7b-ad017c0ac1e6 tempest-GroupsV320Test-624155037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-46f5d0c5-2311-4a84-aa7b-ad017c0ac1e6 tempest-GroupsV320Test-624155037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-46f5d0c5-2311-4a84-aa7b-ad017c0ac1e6 tempest-GroupsV320Test-624155037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-46f5d0c5-2311-4a84-aa7b-ad017c0ac1e6 tempest-GroupsV320Test-624155037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-46f5d0c5-2311-4a84-aa7b-ad017c0ac1e6 tempest-GroupsV320Test-624155037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:55 devstack sudo[83099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:15:55 devstack sudo[83099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:55 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Flow 'volume_create_manager' (f6b24cc5-b6e5-4cea-b898-c6cce9c7d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891b0ea6-2e8f-4a69-97ee-70a8cfae908f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891b0ea6-2e8f-4a69-97ee-70a8cfae908f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2040595666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23a3fb5b-7fb9-42f8-91f5-28a8ed987b04,host='devstack@QuobyteHD#QuobyteHD',id=f361069c-c352-43b6-b10c-c1e3492da62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b721c1090eda4b48bf7dd75613a6ed62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:56Z,use_quota=True,user_id='df9cd0eb7c234a6fac3e5bc6257ce0d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d0b279a-1fad-43b9-864a-d58d58d8b069),volume_type_id=2d0b279a-1fad-43b9-864a-d58d58d8b069)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:56 devstack sudo[83095]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb132d58-cfb3-437b-9397-012b616df459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb132d58-cfb3-437b-9397-012b616df459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3419f033-f076-4147-a3e8-74589905fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3419f033-f076-4147-a3e8-74589905fb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f361069c-c352-43b6-b10c-c1e3492da62e', 'volume_name': 'volume-f361069c-c352-43b6-b10c-c1e3492da62e', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0456d98-9964-48e3-ad3c-37c9c711c5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0456d98-9964-48e3-ad3c-37c9c711c5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e9d0dc-4ff0-487d-8b6f-bbc9ce93d718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:56 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Volume f361069c-c352-43b6-b10c-c1e3492da62e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f361069c-c352-43b6-b10c-c1e3492da62e', 'volume_size': 1} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 1073741824" returned: 0 in 1.288s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:56 devstack sudo[83099]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-46f5d0c5-2311-4a84-aa7b-ad017c0ac1e6 tempest-GroupsV320Test-624155037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.847s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-46f5d0c5-2311-4a84-aa7b-ad017c0ac1e6 tempest-GroupsV320Test-624155037 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-46f5d0c5-2311-4a84-aa7b-ad017c0ac1e6 tempest-GroupsV320Test-624155037 None] Delete group completed successfully. Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:56 devstack sudo[83106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 Apr 24 19:15:56 devstack sudo[83106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:56 devstack sudo[83106]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6" returned: 0 in 0.791s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23a3fb5b-7fb9-42f8-91f5-28a8ed987b04,created_at=2026-04-24T17:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2040595666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23a3fb5b-7fb9-42f8-91f5-28a8ed987b04,host='devstack@QuobyteHD#QuobyteHD',id=f361069c-c352-43b6-b10c-c1e3492da62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b721c1090eda4b48bf7dd75613a6ed62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:56Z,use_quota=True,user_id='df9cd0eb7c234a6fac3e5bc6257ce0d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d0b279a-1fad-43b9-864a-d58d58d8b069),volume_type_id=2d0b279a-1fad-43b9-864a-d58d58d8b069)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Creating volume f361069c-c352-43b6-b10c-c1e3492da62e {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:56 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b8326b-37e1-4667-b83c-acfc0fa96689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8799876b-df2c-427e-a9c1-852a3c89a9e6', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ec9952-a152-4ffc-8116-f196d021475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:56 devstack sudo[83110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e 1073741824 Apr 24 19:15:56 devstack sudo[83110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:56 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Volume volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 (8799876b-df2c-427e-a9c1-852a3c89a9e6): created successfully Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ec9952-a152-4ffc-8116-f196d021475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Flow 'volume_create_manager' (0af1969e-18b9-4149-80d9-0b69fdc29ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-9eeb42a2-c2b2-4064-bbab-a0417a628cea tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Created volume successfully. Apr 24 19:15:58 devstack sudo[83110]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e 1073741824" returned: 0 in 1.127s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:58 devstack sudo[83117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e Apr 24 19:15:58 devstack sudo[83117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:58 devstack sudo[83117]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e" returned: 0 in 0.768s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e9d0dc-4ff0-487d-8b6f-bbc9ce93d718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f361069c-c352-43b6-b10c-c1e3492da62e', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8596be-fdb2-41bf-aec1-afd53a470650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:58 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Volume volume-f361069c-c352-43b6-b10c-c1e3492da62e (f361069c-c352-43b6-b10c-c1e3492da62e): created successfully Apr 24 19:15:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8596be-fdb2-41bf-aec1-afd53a470650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Flow 'volume_create_manager' (f6b24cc5-b6e5-4cea-b898-c6cce9c7d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:58 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b329b450-bf46-462f-9dcc-97e57bcaf233 tempest-GroupSnapshotsTest-33851634 None] Created volume successfully. Apr 24 19:15:59 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-60a8be84-aeb6-4731-a63b-3ca969c9e639 tempest-GroupSnapshotsTest-33851634 None] Update group completed successfully. Apr 24 19:16:00 devstack cinder-volume[81943]: WARNING py.warnings [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-abf30096-5077-4caf-8611-57231739c7c3 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 24 19:16:00 devstack cinder-volume[81943]: .first() Apr 24 19:16:00 devstack cinder-volume[81943]: Apr 24 19:16:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-abf30096-5077-4caf-8611-57231739c7c3 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-abf30096-5077-4caf-8611-57231739c7c3 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:00 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[44427ab6-2588-4549-a3a7-13319e4a9cd3]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-abf30096-5077-4caf-8611-57231739c7c3 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:00 devstack sudo[83137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 Apr 24 19:16:00 devstack sudo[83137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:00 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-0d183f6f-8651-4125-b9c3-fa8bb851a6b1 tempest-GroupSnapshotsTest-33851634 None] Update group completed successfully. Apr 24 19:16:01 devstack sudo[83137]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-abf30096-5077-4caf-8611-57231739c7c3 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6" returned: 0 in 0.865s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-abf30096-5077-4caf-8611-57231739c7c3 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.892s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-abf30096-5077-4caf-8611-57231739c7c3 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db', 'name': 'volume-8799876b-df2c-427e-a9c1-852a3c89a9e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '880da856-617d-48a2-95bd-a6eb6eb9b760', 'enforce_multipath': True} {{(pid=81943) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:16:01 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-55f429c0-9e77-494d-b4b5-0df2a59ab1bd req-abf30096-5077-4caf-8611-57231739c7c3 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] attachment_update completed successfully. Apr 24 19:16:02 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-10289500-703b-4241-8f6a-2e5facd71deb tempest-GroupSnapshotsTest-33851634 None] Update group completed successfully. Apr 24 19:16:03 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-52f7b8b2-69c3-4b6c-bd58-36b98e0f90a6 tempest-GroupSnapshotsTest-33851634 None] Update group completed successfully. Apr 24 19:16:05 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] GroupSnapshot 04f48e86-ad39-4c6c-bfb6-d03fb641af17: creating. Apr 24 19:16:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Group snapshot 04f48e86-ad39-4c6c-bfb6-d03fb641af17: creating. {{(pid=81943) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:16:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Creating offline snapshot 1f4332cf-913f-4990-b710-5f023a429374 of volume f361069c-c352-43b6-b10c-c1e3492da62e {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:16:05 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f7b983-bf4d-4aea-928d-32965fe68d88]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:05 devstack sudo[83217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e Apr 24 19:16:05 devstack sudo[83217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:06 devstack sudo[83217]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e" returned: 0 in 0.840s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:06 devstack sudo[83222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 1G Apr 24 19:16:06 devstack sudo[83222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:07 devstack sudo[83222]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 1G" returned: 0 in 1.241s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f361069c-c352-43b6-b10c-c1e3492da62e -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:07 devstack sudo[83552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f361069c-c352-43b6-b10c-c1e3492da62e -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 Apr 24 19:16:07 devstack sudo[83552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:08 devstack sudo[83552]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f361069c-c352-43b6-b10c-c1e3492da62e -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374" returned: 0 in 0.866s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:08 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:16:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:08 devstack sudo[83597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 Apr 24 19:16:08 devstack sudo[83597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:09 devstack sudo[83597]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374" returned: 0 in 1.048s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:09 devstack sudo[83635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.info Apr 24 19:16:09 devstack sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:10 devstack sudo[83635]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.info" returned: 0 in 1.292s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:10 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:16:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:10 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.info Apr 24 19:16:10 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:11 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.info" returned: 0 in 0.781s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.250s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Creating offline snapshot ab68c921-0834-4019-9f91-96a4defec3be of volume bd8b2f36-8c61-4094-9330-f8f5a38eec3e {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:16:11 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8104b97-4c48-4e22-a70e-81447f998547]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:11 devstack sudo[83647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e Apr 24 19:16:11 devstack sudo[83647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:12 devstack sudo[83647]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" returned: 0 in 0.914s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:12 devstack sudo[83652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be 1G Apr 24 19:16:12 devstack sudo[83652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Flow 'volume_create_manager' (9da46f2a-2453-4607-b689-c617358ac249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d9a029-20d0-44f3-870e-00e00d2a110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d9a029-20d0-44f3-870e-00e00d2a110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1134800853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77d0d0b-1e73-4177-98ab-d69a38a31c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826fc0dcfca0479fa4c0bf1be733af90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:13Z,use_quota=True,user_id='ad81eac40e01443ca8debd39d765450e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc38e07d-ac51-4315-8eee-35ea77ff8a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc38e07d-ac51-4315-8eee-35ea77ff8a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d01a63c-9a76-4dcf-9dc1-38774fad0ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d01a63c-9a76-4dcf-9dc1-38774fad0ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77d0d0b-1e73-4177-98ab-d69a38a31c4a', 'volume_name': 'volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56eb113d-51d4-436d-9f2d-f0e6b482f5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56eb113d-51d4-436d-9f2d-f0e6b482f5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78280d74-c4e2-4a79-8638-f81285b5971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:13 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Volume a77d0d0b-1e73-4177-98ab-d69a38a31c4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a', 'volume_size': 1} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:13 devstack sudo[83652]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be 1G" returned: 0 in 0.962s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:13 devstack sudo[83657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be Apr 24 19:16:13 devstack sudo[83657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:14 devstack sudo[83657]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be" returned: 0 in 0.818s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:14 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:16:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:14 devstack sudo[83663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be Apr 24 19:16:14 devstack sudo[83663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:15 devstack sudo[83663]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be" returned: 0 in 0.681s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:15 devstack sudo[83667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.info Apr 24 19:16:15 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:15 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.info" returned: 0 in 0.619s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:15 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:16:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:15 devstack sudo[83670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.info Apr 24 19:16:15 devstack sudo[83670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:16 devstack sudo[83670]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.info" returned: 0 in 0.624s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.766s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.180s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1134800853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77d0d0b-1e73-4177-98ab-d69a38a31c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826fc0dcfca0479fa4c0bf1be733af90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:13Z,use_quota=True,user_id='ad81eac40e01443ca8debd39d765450e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Creating volume a77d0d0b-1e73-4177-98ab-d69a38a31c4a {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:16 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:16:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:16 devstack sudo[83674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a 1073741824 Apr 24 19:16:16 devstack sudo[83674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:16 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b39214e3-cd29-4c3c-8519-0c1bc429eb7e tempest-GroupSnapshotsTest-33851634 None] group_snapshot 04f48e86-ad39-4c6c-bfb6-d03fb641af17: created successfully Apr 24 19:16:17 devstack sudo[83674]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a 1073741824" returned: 0 in 0.904s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:17 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] group_snapshot 04f48e86-ad39-4c6c-bfb6-d03fb641af17: deleting Apr 24 19:16:17 devstack sudo[83680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a Apr 24 19:16:17 devstack sudo[83680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] group_snapshot 04f48e86-ad39-4c6c-bfb6-d03fb641af17: deleting {{(pid=81943) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-f361069c-c352-43b6-b10c-c1e3492da62e" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-f361069c-c352-43b6-b10c-c1e3492da62e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-1f4332cf-913f-4990-b710-5f023a429374" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-1f4332cf-913f-4990-b710-5f023a429374" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Deleting offline snapshot 1f4332cf-913f-4990-b710-5f023a429374 of volume f361069c-c352-43b6-b10c-c1e3492da62e {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] snapshot_file for this snap is: volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e5c550-c72c-46ee-9fa3-72116b07dac0]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:17 devstack sudo[83682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 Apr 24 19:16:17 devstack sudo[83682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:18 devstack sudo[83680]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a" returned: 0 in 0.861s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78280d74-c4e2-4a79-8638-f81285b5971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62760b0-f794-4751-8c74-30d5ade0339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:18 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Volume volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a (a77d0d0b-1e73-4177-98ab-d69a38a31c4a): created successfully Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62760b0-f794-4751-8c74-30d5ade0339d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Flow 'volume_create_manager' (9da46f2a-2453-4607-b689-c617358ac249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:18 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-7c0e21bb-1b29-4df4-af4d-eeb8470066db tempest-VolumeQuotasAdminTestJSON-1052977170 None] Created volume successfully. Apr 24 19:16:18 devstack sudo[83682]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374" returned: 0 in 0.821s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f361069c-c352-43b6-b10c-c1e3492da62e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7589cf1-521d-4187-8324-484a74a78ca4]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:18 devstack sudo[83688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e Apr 24 19:16:18 devstack sudo[83688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Acquiring lock "cinder-a77d0d0b-1e73-4177-98ab-d69a38a31c4a-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "cinder-a77d0d0b-1e73-4177-98ab-d69a38a31c4a-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Acquiring lock "cinder-quobyte-a77d0d0b-1e73-4177-98ab-d69a38a31c4a" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "cinder-quobyte-a77d0d0b-1e73-4177-98ab-d69a38a31c4a" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:19 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c814d70-909b-45be-8462-200505b4fc04]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:19 devstack sudo[83714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a Apr 24 19:16:19 devstack sudo[83714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:19 devstack sudo[83688]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e" returned: 0 in 1.124s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:19 devstack sudo[83720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 Apr 24 19:16:19 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:20 devstack sudo[83714]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a" returned: 0 in 0.958s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:20 devstack sudo[83730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a Apr 24 19:16:20 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:20 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374" returned: 0 in 0.771s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:20 devstack sudo[83732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374 Apr 24 19:16:20 devstack sudo[83732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:20 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a77d0d0b-1e73-4177-98ab-d69a38a31c4a" returned: 0 in 0.860s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "cinder-quobyte-a77d0d0b-1e73-4177-98ab-d69a38a31c4a" released by "delete_volume" :: held 1.872s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Created reservations ['403fee6e-d5e4-46a4-b720-fddce8cc89c0', '37df2a70-bc76-4fa3-95e1-d2cb84b0a200', 'c5f836f4-050d-4a08-83eb-510feb104a4b', '67eb90db-959a-4891-ac22-44bbecf15088'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:21 devstack sudo[83736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:16:21 devstack sudo[83736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:21 devstack sudo[83732]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e.1f4332cf-913f-4990-b710-5f023a429374" returned: 0 in 1.132s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-1f4332cf-913f-4990-b710-5f023a429374" released by "_delete_snapshot" :: held 4.015s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-f361069c-c352-43b6-b10c-c1e3492da62e" released by "delete_snapshot" :: held 4.044s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-ab68c921-0834-4019-9f91-96a4defec3be" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-ab68c921-0834-4019-9f91-96a4defec3be" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Deleting offline snapshot ab68c921-0834-4019-9f91-96a4defec3be of volume bd8b2f36-8c61-4094-9330-f8f5a38eec3e {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] snapshot_file for this snap is: volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e64dec9-3089-4bdd-a674-736e58078211]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:21 devstack sudo[83739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be Apr 24 19:16:21 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:22 devstack sudo[83736]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.842s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:22 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Deleted volume successfully. Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-12e81b83-d844-4393-841b-08112665d238 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "cinder-a77d0d0b-1e73-4177-98ab-d69a38a31c4a-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Flow 'volume_create_manager' (ed394926-f070-49c9-a963-985d31cbca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2628dbc7-8907-4b5f-ae21-a62e6f709c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2628dbc7-8907-4b5f-ae21-a62e6f709c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-265629023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b6d2af-6ed5-4192-8fab-bac401e94649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826fc0dcfca0479fa4c0bf1be733af90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:22Z,use_quota=True,user_id='ad81eac40e01443ca8debd39d765450e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e98f8a7-88ef-4ba3-8d29-43725c973651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e98f8a7-88ef-4ba3-8d29-43725c973651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef89bdc5-ac75-40c9-96a3-f6f23220c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef89bdc5-ac75-40c9-96a3-f6f23220c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b6d2af-6ed5-4192-8fab-bac401e94649', 'volume_name': 'volume-72b6d2af-6ed5-4192-8fab-bac401e94649', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4659b7-bcd3-4ed4-af83-cab64d6c2b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4659b7-bcd3-4ed4-af83-cab64d6c2b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844083fd-b7d2-4f45-822d-022a192ef205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:22 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Volume 72b6d2af-6ed5-4192-8fab-bac401e94649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b6d2af-6ed5-4192-8fab-bac401e94649', 'volume_size': 1} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-265629023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b6d2af-6ed5-4192-8fab-bac401e94649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826fc0dcfca0479fa4c0bf1be733af90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:22Z,use_quota=True,user_id='ad81eac40e01443ca8debd39d765450e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Creating volume 72b6d2af-6ed5-4192-8fab-bac401e94649 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:22 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:22 devstack sudo[83763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649 1073741824 Apr 24 19:16:22 devstack sudo[83763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:22 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be" returned: 0 in 1.041s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b96f0a-2221-4f9a-b058-82738f129d0d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:22 devstack sudo[83777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e Apr 24 19:16:22 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:23 devstack sudo[83763]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649 1073741824" returned: 0 in 1.026s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:23 devstack sudo[83785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649 Apr 24 19:16:23 devstack sudo[83785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:23 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" returned: 0 in 0.751s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:23 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be Apr 24 19:16:23 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:24 devstack sudo[83785]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649" returned: 0 in 0.772s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844083fd-b7d2-4f45-822d-022a192ef205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b6d2af-6ed5-4192-8fab-bac401e94649', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89945bb-175c-4581-a6dc-c9e7d44db131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:24 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Volume volume-72b6d2af-6ed5-4192-8fab-bac401e94649 (72b6d2af-6ed5-4192-8fab-bac401e94649): created successfully Apr 24 19:16:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89945bb-175c-4581-a6dc-c9e7d44db131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Flow 'volume_create_manager' (ed394926-f070-49c9-a963-985d31cbca6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f98a1e1d-4985-4e48-84c8-44631d81cbf5 tempest-VolumeQuotasAdminTestJSON-1052977170 None] Created volume successfully. Apr 24 19:16:24 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be" returned: 0 in 0.831s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:24 devstack sudo[83817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be Apr 24 19:16:24 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:25 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e.ab68c921-0834-4019-9f91-96a4defec3be" returned: 0 in 0.781s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-ab68c921-0834-4019-9f91-96a4defec3be" released by "_delete_snapshot" :: held 3.545s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" released by "delete_snapshot" :: held 3.581s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:25 devstack cinder-volume[81943]: WARNING cinder.quota [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-187841637 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-187841637, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:25 devstack cinder-volume[81943]: WARNING cinder.quota [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-187841637 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-187841637, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:25 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Created reservations ['a71d6d3a-28a2-4854-bfd9-6feba6989fcf', 'c977191c-4a25-4429-955c-c242157e22f0', 'b826dd09-3407-4b7c-aa54-e36b3c536c29', 'c97ecd5c-9673-4240-8c7c-597456deeb16'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:25 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] Created reservations ['7696a57d-073c-4a0a-b78c-2f65068ec724', '7ce07dd4-5e7b-4514-acff-69266e111044', '45670a8f-6769-4b8f-a0de-812b5295ef17', '002e42e3-0469-4d1c-bdf5-08f12c2a22e5'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:25 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-bb021031-a6ee-4da2-905e-5cefbbdc6eae tempest-GroupSnapshotsTest-33851634 None] group_snapshot 04f48e86-ad39-4c6c-bfb6-d03fb641af17: deleted successfully Apr 24 19:16:25 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b01e6c6a-e4d4-4cc4-878e-00851ba75b20 tempest-VolumeQuotasAdminTestJSON-726518000 None] Transfer volume completed successfully. Apr 24 19:16:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" acquired by "delete_volume" :: waited 0.028s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:26 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a3963d-94a3-40f2-ab71-29e18a0805c1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:26 devstack sudo[83824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e Apr 24 19:16:26 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Acquiring lock "cinder-72b6d2af-6ed5-4192-8fab-bac401e94649-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Lock "cinder-72b6d2af-6ed5-4192-8fab-bac401e94649-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Acquiring lock "cinder-quobyte-72b6d2af-6ed5-4192-8fab-bac401e94649" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Lock "cinder-quobyte-72b6d2af-6ed5-4192-8fab-bac401e94649" acquired by "delete_volume" :: waited 0.030s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:27 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ecf14e-1acf-4f5e-b88b-1e571b40512b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:27 devstack sudo[83829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649 Apr 24 19:16:27 devstack sudo[83829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:27 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" returned: 0 in 0.791s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:27 devstack sudo[83837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e Apr 24 19:16:27 devstack sudo[83837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:27 devstack sudo[83829]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649" returned: 0 in 0.833s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:27 devstack sudo[83846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649 Apr 24 19:16:27 devstack sudo[83846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:28 devstack sudo[83837]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" returned: 0 in 0.782s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-bd8b2f36-8c61-4094-9330-f8f5a38eec3e" released by "delete_volume" :: held 1.688s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-f361069c-c352-43b6-b10c-c1e3492da62e" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-f361069c-c352-43b6-b10c-c1e3492da62e" acquired by "delete_volume" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[931f5b61-20ee-42d0-b403-355f9cfe73c2]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:28 devstack sudo[83853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e Apr 24 19:16:28 devstack sudo[83853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:28 devstack sudo[83846]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-72b6d2af-6ed5-4192-8fab-bac401e94649" returned: 0 in 0.750s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Lock "cinder-quobyte-72b6d2af-6ed5-4192-8fab-bac401e94649" released by "delete_volume" :: held 1.648s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Created reservations ['0e46a609-cf18-4714-840f-aba2ee2bbcc0', 'fe45e055-ad3d-478c-b627-64928a9825f8', 'e7dff0da-d17f-4ed0-8a61-f99c2d15646a', '70ec9115-c5a4-44fa-8ce6-84ca19f9ad5b'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:28 devstack sudo[83872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:16:28 devstack sudo[83872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:29 devstack sudo[83853]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e" returned: 0 in 1.090s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:29 devstack sudo[83893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e Apr 24 19:16:29 devstack sudo[83893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:30 devstack sudo[83872]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.391s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:30 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:30 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Deleted volume successfully. Apr 24 19:16:30 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=77,cinder:SELECT=112,cinder:INSERT=21,cinder:DELETE=4 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:16:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fb6217f1-7db8-4b83-ac7f-bb442aa7d36d tempest-VolumeQuotasAdminTestJSON-1001044411 None] Lock "cinder-72b6d2af-6ed5-4192-8fab-bac401e94649-delete_volume" released by "delete_volume" :: held 3.486s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:30 devstack sudo[83893]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f361069c-c352-43b6-b10c-c1e3492da62e" returned: 0 in 1.255s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-f361069c-c352-43b6-b10c-c1e3492da62e" released by "delete_volume" :: held 2.491s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:30 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=86,cinder:UPDATE=117,cinder:INSERT=22,cinder:DELETE=5 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:16:30 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Created reservations ['8a18729c-5df9-4e55-8f1b-4683f4dedbb5'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:31 devstack cinder-volume[81943]: WARNING cinder.quota [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-187841637 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-187841637, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:31 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Created reservations ['7ceb2470-40db-4765-af15-559a25e16331', '98839c52-93b0-4989-aad6-3401b4b30254', '9167a78d-df97-47c1-b9d8-c8ed90b655ca', 'ae07ca79-2a0f-4aec-8d08-17e23f5ef69e'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:31 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Created reservations ['3c206ea5-ad0d-4cd2-8d19-ee48b354949a', '178339bc-b73f-4776-b441-002592c620c7', '292a7026-796a-4f23-817d-a4dd26b471ef', '68d4fd91-f49b-4c45-ad10-0bf55eb235bb'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:31 devstack sudo[83900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:16:31 devstack sudo[83900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:32 devstack sudo[83900]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.926s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:32 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:32 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1f973e8a-e3c8-4201-870c-b94a94d3246b tempest-GroupSnapshotsTest-33851634 None] Delete group completed successfully. Apr 24 19:16:33 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5a417c40-7113-4e86-b015-ea517ae6d782 tempest-GroupSnapshotsTest-33851634 None] Group tempest-GroupSnapshotsTest-Group-1076303658: creating Apr 24 19:16:33 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5a417c40-7113-4e86-b015-ea517ae6d782 tempest-GroupSnapshotsTest-33851634 None] Group tempest-GroupSnapshotsTest-Group-1076303658: created successfully Apr 24 19:16:33 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5a417c40-7113-4e86-b015-ea517ae6d782 tempest-GroupSnapshotsTest-33851634 None] Create group completed successfully. Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Flow 'volume_create_manager' (4ea51b20-e881-478c-b6e9-a69036d6cd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a62359-aa2e-4bac-95c8-824b6d2de601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a62359-aa2e-4bac-95c8-824b6d2de601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-718126992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3dd6adb4-b0df-4d61-9a5f-b46ca32899e4,host='devstack@QuobyteHD#QuobyteHD',id=09b54214-4ca3-495d-b794-9220eb459b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b721c1090eda4b48bf7dd75613a6ed62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:35Z,use_quota=True,user_id='df9cd0eb7c234a6fac3e5bc6257ce0d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(727e4fad-32b7-48b7-8bc9-4b1d8861bd59),volume_type_id=727e4fad-32b7-48b7-8bc9-4b1d8861bd59)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7774c08-984a-4776-a3d7-f3600a334250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7774c08-984a-4776-a3d7-f3600a334250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98697157-7015-4797-b25c-05a86a9c9737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98697157-7015-4797-b25c-05a86a9c9737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b54214-4ca3-495d-b794-9220eb459b8b', 'volume_name': 'volume-09b54214-4ca3-495d-b794-9220eb459b8b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417ca4a0-cdd4-41d3-9a16-e4f4ce02f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417ca4a0-cdd4-41d3-9a16-e4f4ce02f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e0d1b4-0b5d-4488-9710-326fa20a6965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:35 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Volume 09b54214-4ca3-495d-b794-9220eb459b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b54214-4ca3-495d-b794-9220eb459b8b', 'volume_size': 1} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3dd6adb4-b0df-4d61-9a5f-b46ca32899e4,created_at=2026-04-24T17:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-718126992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3dd6adb4-b0df-4d61-9a5f-b46ca32899e4,host='devstack@QuobyteHD#QuobyteHD',id=09b54214-4ca3-495d-b794-9220eb459b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b721c1090eda4b48bf7dd75613a6ed62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:35Z,use_quota=True,user_id='df9cd0eb7c234a6fac3e5bc6257ce0d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(727e4fad-32b7-48b7-8bc9-4b1d8861bd59),volume_type_id=727e4fad-32b7-48b7-8bc9-4b1d8861bd59)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Creating volume 09b54214-4ca3-495d-b794-9220eb459b8b {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:35 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:16:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:35 devstack sudo[83905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b 1073741824 Apr 24 19:16:35 devstack sudo[83905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:36 devstack sudo[83905]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b 1073741824" returned: 0 in 1.188s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:36 devstack sudo[83926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b Apr 24 19:16:36 devstack sudo[83926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:37 devstack sudo[83926]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b" returned: 0 in 1.071s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] <== create_volume: return (2490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.494s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e0d1b4-0b5d-4488-9710-326fa20a6965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b54214-4ca3-495d-b794-9220eb459b8b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c96cd251-b322-4683-bdde-f7a5994b45a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:38 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Volume volume-09b54214-4ca3-495d-b794-9220eb459b8b (09b54214-4ca3-495d-b794-9220eb459b8b): created successfully Apr 24 19:16:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c96cd251-b322-4683-bdde-f7a5994b45a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Flow 'volume_create_manager' (4ea51b20-e881-478c-b6e9-a69036d6cd55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:38 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-599702d8-11ec-470d-a5f5-8ae6c6d63612 tempest-GroupSnapshotsTest-33851634 None] Created volume successfully. Apr 24 19:16:39 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] GroupSnapshot 0c8fc8ad-7301-481d-a497-56594ac0d6ef: creating. Apr 24 19:16:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Group snapshot 0c8fc8ad-7301-481d-a497-56594ac0d6ef: creating. {{(pid=81943) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:16:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Creating offline snapshot 33dacedc-2567-437a-b44f-d8baf534736b of volume 09b54214-4ca3-495d-b794-9220eb459b8b {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:16:39 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[79261254-d8b3-4446-8954-017c5988137c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:39 devstack sudo[83965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b Apr 24 19:16:39 devstack sudo[83965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:40 devstack sudo[83965]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b" returned: 0 in 1.268s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:40 devstack sudo[83993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b 1G Apr 24 19:16:40 devstack sudo[83993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:16:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:40 devstack sudo[84006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:16:40 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:42 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.084s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:42 devstack sudo[83993]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b 1G" returned: 0 in 1.758s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09b54214-4ca3-495d-b794-9220eb459b8b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:42 devstack sudo[84018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09b54214-4ca3-495d-b794-9220eb459b8b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b Apr 24 19:16:42 devstack sudo[84018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:43 devstack sudo[84018]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09b54214-4ca3-495d-b794-9220eb459b8b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b" returned: 0 in 1.148s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:43 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:16:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:43 devstack sudo[84027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b Apr 24 19:16:43 devstack sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:44 devstack sudo[84027]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b" returned: 0 in 0.879s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:44 devstack sudo[84034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.info Apr 24 19:16:44 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:45 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.info" returned: 0 in 0.626s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:45 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:16:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:45 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.info Apr 24 19:16:45 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:45 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.info" returned: 0 in 0.815s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.680s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:46 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5d8d3418-a250-4dad-9670-42b9db3a4a5f tempest-GroupSnapshotsTest-33851634 None] group_snapshot 0c8fc8ad-7301-481d-a497-56594ac0d6ef: created successfully Apr 24 19:16:47 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] group_snapshot 0c8fc8ad-7301-481d-a497-56594ac0d6ef: deleting Apr 24 19:16:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] group_snapshot 0c8fc8ad-7301-481d-a497-56594ac0d6ef: deleting {{(pid=81943) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:16:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-09b54214-4ca3-495d-b794-9220eb459b8b" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-09b54214-4ca3-495d-b794-9220eb459b8b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-33dacedc-2567-437a-b44f-d8baf534736b" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-33dacedc-2567-437a-b44f-d8baf534736b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Deleting offline snapshot 33dacedc-2567-437a-b44f-d8baf534736b of volume 09b54214-4ca3-495d-b794-9220eb459b8b {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:16:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] snapshot_file for this snap is: volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:16:47 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b56caed-4d10-4d7b-9d70-53b6ada868c4]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:47 devstack sudo[84049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b Apr 24 19:16:47 devstack sudo[84049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:48 devstack sudo[84049]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b" returned: 0 in 0.888s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09b54214-4ca3-495d-b794-9220eb459b8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:48 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d2f29d-ad4a-4c81-bc7c-c4d3f6a1cb3b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:48 devstack sudo[84054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b Apr 24 19:16:48 devstack sudo[84054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:49 devstack sudo[84054]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b" returned: 0 in 0.891s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:49 devstack sudo[84060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b Apr 24 19:16:49 devstack sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:50 devstack sudo[84060]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b" returned: 0 in 0.804s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:50 devstack sudo[84067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b Apr 24 19:16:50 devstack sudo[84067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:50 devstack sudo[84067]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b.33dacedc-2567-437a-b44f-d8baf534736b" returned: 0 in 0.816s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-33dacedc-2567-437a-b44f-d8baf534736b" released by "_delete_snapshot" :: held 3.600s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-09b54214-4ca3-495d-b794-9220eb459b8b" released by "delete_snapshot" :: held 3.651s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:51 devstack cinder-volume[81943]: WARNING cinder.quota [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-254049613 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-254049613, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:51 devstack cinder-volume[81943]: WARNING cinder.quota [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-254049613 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-254049613, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:51 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] Created reservations ['7730b489-0af4-4810-a0b5-6dd6cc927b1a', 'e19b7ccc-b4a0-4ea8-8f77-1cb0d0508376', 'ea0311bc-a557-4149-8241-24b191167f98', '2911b7fa-be19-4950-be60-67b561959ead'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:51 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-29d714eb-1d4c-44f9-9272-6ff6c84df22a tempest-GroupSnapshotsTest-33851634 None] group_snapshot 0c8fc8ad-7301-481d-a497-56594ac0d6ef: deleted successfully Apr 24 19:16:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "cinder-quobyte-09b54214-4ca3-495d-b794-9220eb459b8b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-09b54214-4ca3-495d-b794-9220eb459b8b" acquired by "delete_volume" :: waited 0.036s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:52 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b964ca3f-bdad-4844-ab67-4f68d8714c18]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:52 devstack sudo[84087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b Apr 24 19:16:52 devstack sudo[84087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:53 devstack sudo[84087]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b" returned: 0 in 0.864s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:53 devstack sudo[84099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b Apr 24 19:16:53 devstack sudo[84099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:53 devstack sudo[84099]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-09b54214-4ca3-495d-b794-9220eb459b8b" returned: 0 in 0.637s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Lock "cinder-quobyte-09b54214-4ca3-495d-b794-9220eb459b8b" released by "delete_volume" :: held 1.597s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:53 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Created reservations ['ef4b4db3-4274-4447-a74f-67e7013e5696'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:53 devstack cinder-volume[81943]: WARNING cinder.quota [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-254049613 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-254049613, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:53 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Created reservations ['09904c74-f61f-4e3a-aa7c-2ec041d742b9', '554ebdeb-bb44-4646-80d5-3e09cc27353b', '077c582c-ac76-4e5a-a23d-126b01435e74', '2d82fa60-e797-4832-849b-e503910da415'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:54 devstack sudo[84102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:16:54 devstack sudo[84102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:54 devstack sudo[84102]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.701s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:54 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:54 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-2760e4ba-a4f0-480a-9715-523fb27c9a04 tempest-GroupSnapshotsTest-33851634 None] Delete group completed successfully. Apr 24 19:17:04 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=34,cinder:UPDATE=42,cinder:INSERT=5 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:17:04 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=41,cinder:SELECT=41,cinder:INSERT=15,cinder:DELETE=1 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:17:04 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c205aa70-4c8c-4ed3-a5d0-17b54d826e2a tempest-GroupSnapshotsV319Test-2129222565 None] Group tempest-GroupSnapshotsV319Test-Group-1444125795: creating Apr 24 19:17:04 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c205aa70-4c8c-4ed3-a5d0-17b54d826e2a tempest-GroupSnapshotsV319Test-2129222565 None] Group tempest-GroupSnapshotsV319Test-Group-1444125795: created successfully Apr 24 19:17:04 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c205aa70-4c8c-4ed3-a5d0-17b54d826e2a tempest-GroupSnapshotsV319Test-2129222565 None] Create group completed successfully. Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Flow 'volume_create_manager' (32fb2fb7-8bde-41b9-83de-76dc7add4611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51d35c2-9deb-4a7d-abde-c16b4134f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51d35c2-9deb-4a7d-abde-c16b4134f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-853872887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5aafdd1a-0f73-4d7b-84e1-7da51d881f4e,host='devstack@QuobyteHD#QuobyteHD',id=c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e3b21a2a9b43bd908f28a821e6fef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:07Z,use_quota=True,user_id='ec40ca6be92f4b85acb64d5fc085d049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(465a121c-26ef-4335-8cb0-c2425dfe6d6d),volume_type_id=465a121c-26ef-4335-8cb0-c2425dfe6d6d)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2a9527-af8a-4fd1-981d-ca7574185bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2a9527-af8a-4fd1-981d-ca7574185bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3e5d94-2052-4c6b-8e56-e083deb04804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3e5d94-2052-4c6b-8e56-e083deb04804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb', 'volume_name': 'volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70de2a5d-8e98-40e7-a1e2-3b2c5d681472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70de2a5d-8e98-40e7-a1e2-3b2c5d681472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a191f9-c1fd-47c1-adf6-af155e60dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:06 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Volume c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb', 'volume_size': 1} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5aafdd1a-0f73-4d7b-84e1-7da51d881f4e,created_at=2026-04-24T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-853872887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5aafdd1a-0f73-4d7b-84e1-7da51d881f4e,host='devstack@QuobyteHD#QuobyteHD',id=c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e3b21a2a9b43bd908f28a821e6fef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:07Z,use_quota=True,user_id='ec40ca6be92f4b85acb64d5fc085d049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(465a121c-26ef-4335-8cb0-c2425dfe6d6d),volume_type_id=465a121c-26ef-4335-8cb0-c2425dfe6d6d)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Creating volume c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:06 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:17:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:07 devstack sudo[84191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb 1073741824 Apr 24 19:17:07 devstack sudo[84191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:08 devstack sudo[84191]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb 1073741824" returned: 0 in 1.801s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:08 devstack sudo[84265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb Apr 24 19:17:08 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:10 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" returned: 0 in 1.568s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] <== create_volume: return (3482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.491s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:10 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a191f9-c1fd-47c1-adf6-af155e60dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:10 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6fe88b5-2801-4540-bd88-9f38210e3d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:10 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Volume volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb (c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb): created successfully Apr 24 19:17:10 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6fe88b5-2801-4540-bd88-9f38210e3d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:10 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Flow 'volume_create_manager' (32fb2fb7-8bde-41b9-83de-76dc7add4611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:10 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-60a92f98-f813-4931-bc7e-26d350339280 tempest-GroupSnapshotsV319Test-2129222565 None] Created volume successfully. Apr 24 19:17:12 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] GroupSnapshot 26c8030a-9d0b-4a2f-a19c-fbf794314470: creating. Apr 24 19:17:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Group snapshot 26c8030a-9d0b-4a2f-a19c-fbf794314470: creating. {{(pid=81943) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:17:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:12 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Creating offline snapshot b04c36eb-e73d-4066-8042-59d0ce2c0276 of volume c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:17:12 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab484eec-b710-46f8-a8ca-95624ac6c784]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:12 devstack sudo[84293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb Apr 24 19:17:12 devstack sudo[84293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:13 devstack sudo[84293]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" returned: 0 in 0.779s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:13 devstack sudo[84298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 1G Apr 24 19:17:13 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:14 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 1G" returned: 0 in 1.493s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:14 devstack sudo[84325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 Apr 24 19:17:14 devstack sudo[84325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:16 devstack sudo[84325]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276" returned: 0 in 1.718s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:16 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:17:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:16 devstack sudo[84342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 Apr 24 19:17:16 devstack sudo[84342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:17 devstack sudo[84342]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276" returned: 0 in 1.301s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:18 devstack sudo[84377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.info Apr 24 19:17:18 devstack sudo[84377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:18 devstack sudo[84377]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.info" returned: 0 in 0.983s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:18 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:17:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:19 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.info Apr 24 19:17:19 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Flow 'volume_create_manager' (75c06704-4e43-4d1e-9457-16dc77452b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bab5362-ed25-49b9-b9d7-32c4e0304b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bab5362-ed25-49b9-b9d7-32c4e0304b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1726511693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3cffb4-43c0-4d61-98ce-16829a71a890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbb703d786a4031a393a7d2ca8f9e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:20Z,use_quota=True,user_id='d204394200c0483caf6c1a84dc9756dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691fd1bb-3b2c-43fb-9bf2-6897c1bb1ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691fd1bb-3b2c-43fb-9bf2-6897c1bb1ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5094b9e3-ee52-43f8-ad9c-d6bdc8b4a968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5094b9e3-ee52-43f8-ad9c-d6bdc8b4a968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da3cffb4-43c0-4d61-98ce-16829a71a890', 'volume_name': 'volume-da3cffb4-43c0-4d61-98ce-16829a71a890', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3034714b-b45f-4d23-907b-fe699e562f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3034714b-b45f-4d23-907b-fe699e562f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc0d016-915d-4ba4-9f57-6b996b6a42d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:19 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Volume da3cffb4-43c0-4d61-98ce-16829a71a890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da3cffb4-43c0-4d61-98ce-16829a71a890', 'volume_size': 1} Apr 24 19:17:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:20 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.info" returned: 0 in 1.059s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.518s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.186s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1726511693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3cffb4-43c0-4d61-98ce-16829a71a890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbb703d786a4031a393a7d2ca8f9e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:20Z,use_quota=True,user_id='d204394200c0483caf6c1a84dc9756dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Creating volume da3cffb4-43c0-4d61-98ce-16829a71a890 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:20 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:17:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:20 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 1073741824 Apr 24 19:17:20 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:20 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-7a17f154-7c85-4d76-a346-c3dd420d538c tempest-GroupSnapshotsV319Test-2129222565 None] group_snapshot 26c8030a-9d0b-4a2f-a19c-fbf794314470: created successfully Apr 24 19:17:21 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 1073741824" returned: 0 in 1.657s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:21 devstack sudo[84389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 Apr 24 19:17:21 devstack sudo[84389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:22 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] group_snapshot 26c8030a-9d0b-4a2f-a19c-fbf794314470: deleting Apr 24 19:17:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] group_snapshot 26c8030a-9d0b-4a2f-a19c-fbf794314470: deleting {{(pid=81943) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:17:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Acquiring lock "cinder-quobyte-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "cinder-quobyte-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" acquired by "delete_snapshot" :: waited 0.071s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Acquiring lock "cinder-quobyte-b04c36eb-e73d-4066-8042-59d0ce2c0276" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "cinder-quobyte-b04c36eb-e73d-4066-8042-59d0ce2c0276" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Deleting offline snapshot b04c36eb-e73d-4066-8042-59d0ce2c0276 of volume c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:17:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] snapshot_file for this snap is: volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:17:22 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fdd4da-b424-4872-bfa0-96106fe1e635]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:22 devstack sudo[84391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 Apr 24 19:17:22 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:23 devstack sudo[84389]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890" returned: 0 in 1.201s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] <== create_volume: return (2952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.964s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc0d016-915d-4ba4-9f57-6b996b6a42d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da3cffb4-43c0-4d61-98ce-16829a71a890', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00596a7-47eb-4125-963a-0bbfe040b185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:23 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Volume volume-da3cffb4-43c0-4d61-98ce-16829a71a890 (da3cffb4-43c0-4d61-98ce-16829a71a890): created successfully Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00596a7-47eb-4125-963a-0bbfe040b185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Flow 'volume_create_manager' (75c06704-4e43-4d1e-9457-16dc77452b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:23 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-fc2ba7f7-e941-44f4-8f43-b461a4824752 tempest-DeleteServersTestJSON-1858044860 None] Created volume successfully. Apr 24 19:17:23 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276" returned: 0 in 1.245s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e75edc3-8623-4a19-8320-722d1f88c9d4]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:24 devstack sudo[84397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb Apr 24 19:17:24 devstack sudo[84397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:25 devstack sudo[84397]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" returned: 0 in 1.713s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:25 devstack sudo[84412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 Apr 24 19:17:25 devstack sudo[84412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:26 devstack sudo[84412]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276" returned: 0 in 0.874s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:26 devstack sudo[84419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276 Apr 24 19:17:26 devstack sudo[84419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:27 devstack sudo[84419]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb.b04c36eb-e73d-4066-8042-59d0ce2c0276" returned: 0 in 0.770s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "cinder-quobyte-b04c36eb-e73d-4066-8042-59d0ce2c0276" released by "_delete_snapshot" :: held 4.761s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "cinder-quobyte-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" released by "delete_snapshot" :: held 4.801s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:27 devstack cinder-volume[81943]: WARNING cinder.quota [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1691739647 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1691739647, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:17:27 devstack cinder-volume[81943]: WARNING cinder.quota [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1691739647 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1691739647, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:17:27 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] Created reservations ['b6870e69-668c-494f-8bee-87f6a658ffdf', 'dc9035ba-8dbe-416e-ac9a-e94eb754cc2a', '312b1493-382b-4b69-b1d7-ed8288ff463d', '7b99709d-ea46-48e5-bc75-3c4769e276d3'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:27 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c6790d07-5375-4901-9532-34da9be81cf0 tempest-GroupSnapshotsV319Test-2129222565 None] group_snapshot 26c8030a-9d0b-4a2f-a19c-fbf794314470: deleted successfully Apr 24 19:17:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Acquiring lock "cinder-quobyte-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "cinder-quobyte-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" acquired by "delete_volume" :: waited 0.080s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:28 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8dec69-ebcb-4a2e-ad21-a27e2911df49]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-0a889ada-6d0c-4ec3-88b1-51cae3cb2637 req-42427519-3814-41dc-bb60-2d1aed00f236 tempest-DeleteServersTestJSON-1858044860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-0a889ada-6d0c-4ec3-88b1-51cae3cb2637 req-42427519-3814-41dc-bb60-2d1aed00f236 tempest-DeleteServersTestJSON-1858044860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:28 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b5088d-752a-41dd-ae77-cc14d4168f9a]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-0a889ada-6d0c-4ec3-88b1-51cae3cb2637 req-42427519-3814-41dc-bb60-2d1aed00f236 tempest-DeleteServersTestJSON-1858044860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:28 devstack sudo[84432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb Apr 24 19:17:28 devstack sudo[84432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:29 devstack sudo[84433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 Apr 24 19:17:29 devstack sudo[84433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:29 devstack sudo[84432]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" returned: 0 in 1.267s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:29 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb Apr 24 19:17:29 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:29 devstack sudo[84433]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-0a889ada-6d0c-4ec3-88b1-51cae3cb2637 req-42427519-3814-41dc-bb60-2d1aed00f236 tempest-DeleteServersTestJSON-1858044860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890" returned: 0 in 1.220s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-0a889ada-6d0c-4ec3-88b1-51cae3cb2637 req-42427519-3814-41dc-bb60-2d1aed00f236 tempest-DeleteServersTestJSON-1858044860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.262s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:29 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-0a889ada-6d0c-4ec3-88b1-51cae3cb2637 req-42427519-3814-41dc-bb60-2d1aed00f236 tempest-DeleteServersTestJSON-1858044860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db', 'name': 'volume-da3cffb4-43c0-4d61-98ce-16829a71a890', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc31c90f-4d36-404a-bbb2-574acbe8a1ac', 'enforce_multipath': True} {{(pid=81943) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:17:30 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-0a889ada-6d0c-4ec3-88b1-51cae3cb2637 req-42427519-3814-41dc-bb60-2d1aed00f236 tempest-DeleteServersTestJSON-1858044860 None] attachment_update completed successfully. Apr 24 19:17:30 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" returned: 0 in 0.725s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "cinder-quobyte-c3a5aa42-f02f-4b3d-b6d5-843c1ba207fb" released by "delete_volume" :: held 2.128s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:30 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Created reservations ['e9716759-12c3-4708-a3f6-8652e5381e5f'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:30 devstack cinder-volume[81943]: WARNING cinder.quota [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1691739647 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1691739647, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:17:30 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Created reservations ['1c30cd82-dc56-4365-97af-bfc1447f5f11', 'c3833851-7e3f-410f-a58f-607557fa9404', '95948a79-39f5-4a5a-9808-8fa52cb7ab74', '244f2fdf-4094-440a-babf-8e5a5a42be9c'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:31 devstack sudo[84481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:17:31 devstack sudo[84481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:32 devstack sudo[84481]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.914s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:32 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:32 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-cd312568-a516-4da6-acfd-35bceb683074 tempest-GroupSnapshotsV319Test-2129222565 None] Delete group completed successfully. Apr 24 19:17:33 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Flow 'volume_create_manager' (6d09e386-5862-4c8b-af9d-093d9b412393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f0dbd0-f5ae-4866-b532-78322ebff072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f0dbd0-f5ae-4866-b532-78322ebff072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:33Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d764c1ae-458c-4d5f-af3c-cae195120add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511e39e762144655ad58a26fe4fc9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:34Z,use_quota=True,user_id='274a8b3ced9b4c8da93c060403ee1dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360615b6-9282-410f-a06f-b51cc043c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360615b6-9282-410f-a06f-b51cc043c32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc44a7ab-38be-4f65-8027-20dc2d8ba524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:34 devstack cinder-volume[81943]: DEBUG cinder.image.glance [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Creating Keystone auth plugin from conf {{(pid=81943) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:17:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc44a7ab-38be-4f65-8027-20dc2d8ba524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd764c1ae-458c-4d5f-af3c-cae195120add', 'volume_name': 'volume-d764c1ae-458c-4d5f-af3c-cae195120add', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623426a3-bdf4-4663-9ab1-35f16cc4b44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623426a3-bdf4-4663-9ab1-35f16cc4b44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6f7fac-d8dc-469d-adcb-56e6f2c15956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:34 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Volume d764c1ae-458c-4d5f-af3c-cae195120add: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d764c1ae-458c-4d5f-af3c-cae195120add', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:17:34 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Trying to clone d764c1ae-458c-4d5f-af3c-cae195120add from image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]). {{(pid=81943) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:17:35 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:17:35 devstack cinder-volume[81943]: INFO cinder.image.image_utils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:17:35 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[5517baa5-a18a-422b-8ef4-54d2f55018fb]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:35 devstack sudo[84512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD Apr 24 19:17:35 devstack sudo[84512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:36 devstack sudo[84512]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:36 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Temporary image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 is fetched for user 274a8b3ced9b4c8da93c060403ee1dc8. {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:17:36 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d803e342-ed45-47d6-a702-20cea74942af]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:36 devstack sudo[84519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD Apr 24 19:17:36 devstack sudo[84519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:37 devstack sudo[84519]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD" returned: 0 in 0.994s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:33Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d764c1ae-458c-4d5f-af3c-cae195120add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511e39e762144655ad58a26fe4fc9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:34Z,use_quota=True,user_id='274a8b3ced9b4c8da93c060403ee1dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Creating volume d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:37 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:17:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:37 devstack sudo[84551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add 1073741824 Apr 24 19:17:37 devstack sudo[84551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:38 devstack sudo[84551]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add 1073741824" returned: 0 in 1.305s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:38 devstack sudo[84560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add Apr 24 19:17:38 devstack sudo[84560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:39 devstack sudo[84560]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add" returned: 0 in 0.850s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:39 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Attempting download of 0ac46f6e-0b50-4bf2-95dd-aa609d212809 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}])) to volume d764c1ae-458c-4d5f-af3c-cae195120add. {{(pid=81943) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:17:39 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8b351d-b7e8-4685-a50a-a7ea68eb9a2c]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_9md554fj {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:39 devstack sudo[84579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_9md554fj Apr 24 19:17:39 devstack sudo[84579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:40 devstack sudo[84579]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_9md554fj" returned: 0 in 0.861s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_9md554fj {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:40 devstack sudo[84586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_9md554fj Apr 24 19:17:40 devstack sudo[84586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:17:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:40 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-729f899b-9055-4bf0-bfea-d55ecb1cb62f req-9ff5c62b-8300-4bed-868d-3e5c164e2866 tempest-DeleteServersTestJSON-1858044860 None] Terminate volume connection completed successfully. Apr 24 19:17:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-729f899b-9055-4bf0-bfea-d55ecb1cb62f req-9ff5c62b-8300-4bed-868d-3e5c164e2866 tempest-DeleteServersTestJSON-1858044860 None] Deleting attachment dc31c90f-4d36-404a-bbb2-574acbe8a1ac. {{(pid=81943) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:17:40 devstack sudo[84588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:17:40 devstack sudo[84588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:41 devstack sudo[84586]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_9md554fj" returned: 1 in 0.863s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_9md554fj' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:17:41 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57748db-5273-471f-abee-c61e888a94a0]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:41 devstack sudo[84598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD Apr 24 19:17:41 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:42 devstack sudo[84588]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.089s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:42 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:42 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] 0ac46f6e-0b50-4bf2-95dd-aa609d212809 was qcow2, converting to raw {{(pid=81943) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:17:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:42 devstack sudo[84606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add Apr 24 19:17:42 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:44 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add" returned: 0 in 2.004s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:44 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_6ixi_9eadevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:17:44 devstack cinder-volume[81943]: INFO cinder.image.image_utils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Converted 112.00 MB image at 55.86 MB/s Apr 24 19:17:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:44 devstack sudo[84617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add 1G Apr 24 19:17:44 devstack sudo[84617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:45 devstack sudo[84617]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add 1G" returned: 0 in 0.926s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:45 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f15db-b09a-4f94-98f5-640a102eb702]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:45 devstack sudo[84626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add Apr 24 19:17:45 devstack sudo[84626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Acquiring lock "cinder-da3cffb4-43c0-4d61-98ce-16829a71a890-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Lock "cinder-da3cffb4-43c0-4d61-98ce-16829a71a890-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Acquiring lock "cinder-quobyte-da3cffb4-43c0-4d61-98ce-16829a71a890" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Lock "cinder-quobyte-da3cffb4-43c0-4d61-98ce-16829a71a890" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:45 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f56e45-9570-4f8f-8262-755d583453a6]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:45 devstack sudo[84628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 Apr 24 19:17:45 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:46 devstack sudo[84626]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add" returned: 0 in 0.786s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:46 devstack sudo[84632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add Apr 24 19:17:46 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890" returned: 0 in 0.876s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:46 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:46 devstack sudo[84640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890 Apr 24 19:17:46 devstack sudo[84640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:46 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add" returned: 1 in 0.839s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Downloaded image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}])) to volume d764c1ae-458c-4d5f-af3c-cae195120add successfully. {{(pid=81943) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Temporary image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 for user 274a8b3ced9b4c8da93c060403ee1dc8 is deleted. {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Marking volume d764c1ae-458c-4d5f-af3c-cae195120add as bootable. {{(pid=81943) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Copying metadata from image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 to d764c1ae-458c-4d5f-af3c-cae195120add. {{(pid=81943) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:17:46 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Creating volume glance metadata for volume d764c1ae-458c-4d5f-af3c-cae195120add backed by image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81943) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6f7fac-d8dc-469d-adcb-56e6f2c15956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d764c1ae-458c-4d5f-af3c-cae195120add', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a0d65c-ad0d-496f-9fd9-cb80104051d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:47 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Volume volume-d764c1ae-458c-4d5f-af3c-cae195120add (d764c1ae-458c-4d5f-af3c-cae195120add): created successfully Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a0d65c-ad0d-496f-9fd9-cb80104051d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Flow 'volume_create_manager' (6d09e386-5862-4c8b-af9d-093d9b412393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:47 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-d3cb8793-1538-4b04-8336-8e61e3009121 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Created volume successfully. Apr 24 19:17:47 devstack sudo[84640]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-da3cffb4-43c0-4d61-98ce-16829a71a890" returned: 0 in 0.701s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Lock "cinder-quobyte-da3cffb4-43c0-4d61-98ce-16829a71a890" released by "delete_volume" :: held 1.642s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Created reservations ['f583452b-3e14-4e2b-a59c-49625c96a544', '8bd008c5-3a0d-4e8c-8680-b74e6e37fa2b', '289f3701-9b16-441b-9b0f-9362d9ef0679', '182f4de4-e587-4b5c-b890-af9c060201e3'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:47 devstack sudo[84653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:17:47 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:48 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Flow 'volume_create_manager' (05cae44d-212f-4623-b455-5fd30d99c1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb75ccc4-7901-4f8d-ad8a-83e69f9e2a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.275s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:48 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Deleted volume successfully. Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb75ccc4-7901-4f8d-ad8a-83e69f9e2a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-491551402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136a711e-58aa-4cd2-997a-bbdab4cd93f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b7e2b215b740f283283a3518cdf7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:49Z,use_quota=True,user_id='43e6bd685ed849a3bcbad0423dbff997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9ca427-5c0f-4a09-961f-8632d96fc1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9ca427-5c0f-4a09-961f-8632d96fc1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8720ed-da05-48bf-84e8-e88cc8434124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8720ed-da05-48bf-84e8-e88cc8434124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136a711e-58aa-4cd2-997a-bbdab4cd93f0', 'volume_name': 'volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28395dc8-3537-4494-aa00-2e2214d2583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28395dc8-3537-4494-aa00-2e2214d2583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfced18-e682-4510-ac3b-9c68a8e896d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:48 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0', 'volume_size': 1} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-491551402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136a711e-58aa-4cd2-997a-bbdab4cd93f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b7e2b215b740f283283a3518cdf7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:49Z,use_quota=True,user_id='43e6bd685ed849a3bcbad0423dbff997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Creating volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:48 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0992d255-8ee0-4b2a-afa1-b290998f15df tempest-DeleteServersTestJSON-1858044860 None] Lock "cinder-da3cffb4-43c0-4d61-98ce-16829a71a890-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:48 devstack sudo[84693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 1073741824 Apr 24 19:17:48 devstack sudo[84693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-f25c1c8e-efaf-4f84-92d1-f4ab26760b94 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:50 devstack sudo[84693]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 1073741824" returned: 0 in 1.567s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:50 devstack sudo[84710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 Apr 24 19:17:50 devstack sudo[84710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:51 devstack sudo[84710]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0" returned: 0 in 0.943s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] <== create_volume: return (2603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.608s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-f25c1c8e-efaf-4f84-92d1-f4ab26760b94 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.112s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfced18-e682-4510-ac3b-9c68a8e896d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db611e1d-6b92-4ff6-859e-0bc903e20ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:51 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb8e681-e7cc-4209-a607-fec6e91fbc82]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-f25c1c8e-efaf-4f84-92d1-f4ab26760b94 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:51 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Volume volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 (136a711e-58aa-4cd2-997a-bbdab4cd93f0): created successfully Apr 24 19:17:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db611e1d-6b92-4ff6-859e-0bc903e20ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Flow 'volume_create_manager' (05cae44d-212f-4623-b455-5fd30d99c1bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:51 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d3a231a6-ae30-486e-8f43-eb3d070737b8 tempest-SnapshotsActionsTest-308656070 None] Created volume successfully. Apr 24 19:17:51 devstack sudo[84714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add Apr 24 19:17:51 devstack sudo[84714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (34bd361d-2488-4451-a885-2d91b35fa734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36f84c2-4a5b-4aa0-b8d5-c0f5733d785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36f84c2-4a5b-4aa0-b8d5-c0f5733d785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-442916540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca347c8-fcc5-4f5e-a837-79fd5356d45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:52Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df74595-f668-4de3-ba86-dcc43c52d66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df74595-f668-4de3-ba86-dcc43c52d66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6021a6-5f95-4e2b-bf5b-75b5baffd2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6021a6-5f95-4e2b-bf5b-75b5baffd2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca347c8-fcc5-4f5e-a837-79fd5356d45c', 'volume_name': 'volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c23d769-d742-4aad-9e94-e5b78f08eaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c23d769-d742-4aad-9e94-e5b78f08eaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1343fbd-6ce8-4613-88d2-a656fad51afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:52 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Volume 6ca347c8-fcc5-4f5e-a837-79fd5356d45c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c', 'volume_size': 1} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:52 devstack sudo[84714]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-f25c1c8e-efaf-4f84-92d1-f4ab26760b94 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add" returned: 0 in 1.361s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-f25c1c8e-efaf-4f84-92d1-f4ab26760b94 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:53 devstack sudo[84719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add Apr 24 19:17:53 devstack sudo[84719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:53 devstack sudo[84719]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-f25c1c8e-efaf-4f84-92d1-f4ab26760b94 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add" returned: 1 in 0.833s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-f25c1c8e-efaf-4f84-92d1-f4ab26760b94 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-f25c1c8e-efaf-4f84-92d1-f4ab26760b94 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.323s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.048s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-442916540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca347c8-fcc5-4f5e-a837-79fd5356d45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:52Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Creating volume 6ca347c8-fcc5-4f5e-a837-79fd5356d45c {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:53 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:53 devstack sudo[84724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c 1073741824 Apr 24 19:17:53 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-f25c1c8e-efaf-4f84-92d1-f4ab26760b94 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db', 'name': 'volume-d764c1ae-458c-4d5f-af3c-cae195120add', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8842ad4-01f3-4e06-9b93-6d0e9b399409', 'enforce_multipath': True} {{(pid=81943) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:17:54 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-ce46c572-e211-4530-bd2a-4ab0d955d2db req-f25c1c8e-efaf-4f84-92d1-f4ab26760b94 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] attachment_update completed successfully. Apr 24 19:17:55 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c 1073741824" returned: 0 in 1.236s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:55 devstack sudo[84730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c Apr 24 19:17:55 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:55 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c" returned: 0 in 0.867s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.203s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1343fbd-6ce8-4613-88d2-a656fad51afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c7d642-2418-419a-a86b-e51c0f09e203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:56 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Volume volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c (6ca347c8-fcc5-4f5e-a837-79fd5356d45c): created successfully Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c7d642-2418-419a-a86b-e51c0f09e203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (34bd361d-2488-4451-a885-2d91b35fa734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Creating offline snapshot 0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b of volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:17:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3d6dabfe-25cb-425b-927d-9bb25afce2b3 tempest-VolumesActionsTest-1603037564 None] Created volume successfully. Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9125557-591f-41a3-8275-ac0bbd37aa81]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:56 devstack sudo[84733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 Apr 24 19:17:56 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9bccfbc7-b124-4085-94b7-a8ace16646f3 tempest-VolumesActionsTest-1603037564 None] Acquiring lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c" by "attach_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9bccfbc7-b124-4085-94b7-a8ace16646f3 tempest-VolumesActionsTest-1603037564 None] Lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c" acquired by "attach_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:57 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9bccfbc7-b124-4085-94b7-a8ace16646f3 tempest-VolumesActionsTest-1603037564 None] Attaching volume 6ca347c8-fcc5-4f5e-a837-79fd5356d45c to instance 343cbbaf-bff3-4ed1-a580-70be7899c9ec at mountpoint /dev/vdb on host None. Apr 24 19:17:57 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9bccfbc7-b124-4085-94b7-a8ace16646f3 tempest-VolumesActionsTest-1603037564 None] Attach volume completed successfully. Apr 24 19:17:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9bccfbc7-b124-4085-94b7-a8ace16646f3 tempest-VolumesActionsTest-1603037564 None] Lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c" released by "attach_volume" :: held 0.199s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:57 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0" returned: 0 in 0.926s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:57 devstack sudo[84738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b 1G Apr 24 19:17:57 devstack sudo[84738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:58 devstack sudo[84738]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:58 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-04821592-4932-4817-ae90-c306de746fd0 tempest-VolumesActionsTest-769729233 None] Terminate volume connection completed successfully. Apr 24 19:17:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b 1G" returned: 0 in 1.141s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:58 devstack sudo[84747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:17:58 devstack sudo[84747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-04821592-4932-4817-ae90-c306de746fd0 tempest-VolumesActionsTest-769729233 None] Acquiring lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c-detach_volume" by "detach_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-04821592-4932-4817-ae90-c306de746fd0 tempest-VolumesActionsTest-769729233 None] Lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:58 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-04821592-4932-4817-ae90-c306de746fd0 tempest-VolumesActionsTest-769729233 None] Detaching volume 6ca347c8-fcc5-4f5e-a837-79fd5356d45c from instance 343cbbaf-bff3-4ed1-a580-70be7899c9ec. Apr 24 19:17:59 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-04821592-4932-4817-ae90-c306de746fd0 tempest-VolumesActionsTest-769729233 None] Detach volume completed successfully. Apr 24 19:17:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-04821592-4932-4817-ae90-c306de746fd0 tempest-VolumesActionsTest-769729233 None] Lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:59 devstack sudo[84747]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 1.010s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:59 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b is being set with open permissions: ugo+rw Apr 24 19:17:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:59 devstack sudo[84755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:17:59 devstack sudo[84755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8ecf9d2-d18f-4770-ba58-ff898e0ba42a tempest-VolumesActionsTest-1603037564 None] Acquiring lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c-detach_volume" by "detach_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8ecf9d2-d18f-4770-ba58-ff898e0ba42a tempest-VolumesActionsTest-1603037564 None] Lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:59 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-a8ecf9d2-d18f-4770-ba58-ff898e0ba42a tempest-VolumesActionsTest-1603037564 None] Volume detach called, but volume not attached. Apr 24 19:17:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8ecf9d2-d18f-4770-ba58-ff898e0ba42a tempest-VolumesActionsTest-1603037564 None] Lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:00 devstack sudo[84755]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 1.206s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:00 devstack sudo[84777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.info Apr 24 19:18:00 devstack sudo[84777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Acquiring lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Acquiring lock "cinder-quobyte-6ca347c8-fcc5-4f5e-a837-79fd5356d45c" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Lock "cinder-quobyte-6ca347c8-fcc5-4f5e-a837-79fd5356d45c" acquired by "delete_volume" :: waited 0.061s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:01 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c886b1-26fc-40b2-823b-6a0b1e6eba9e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:01 devstack sudo[84790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c Apr 24 19:18:01 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:02 devstack sudo[84777]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.info" returned: 0 in 1.350s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:02 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.info is being set with open permissions: ugo+rw Apr 24 19:18:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:02 devstack sudo[84805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.info Apr 24 19:18:02 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:02 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c" returned: 0 in 1.533s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:02 devstack sudo[84843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c Apr 24 19:18:02 devstack sudo[84843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:03 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.info" returned: 0 in 1.432s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.475s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:03 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e52f2955-794a-4184-9a43-abeb5dc734e1 tempest-SnapshotsActionsTest-308656070 None] Create snapshot completed successfully Apr 24 19:18:04 devstack sudo[84843]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6ca347c8-fcc5-4f5e-a837-79fd5356d45c" returned: 0 in 1.176s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Lock "cinder-quobyte-6ca347c8-fcc5-4f5e-a837-79fd5356d45c" released by "delete_volume" :: held 2.821s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=70,cinder:UPDATE=47,cinder:INSERT=18,cinder:DELETE=3 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=59,cinder:SELECT=72,cinder:INSERT=17,cinder:DELETE=4 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Created reservations ['7ec4a123-6437-499c-b7c0-fbdfa1f01217', '1064d323-8124-4c87-8839-6c00c3f4fdaa', '9c63d78d-b7d8-4d0e-a984-fd91d38559cb', 'baf38711-381d-4a9d-9750-16e0b35a6495'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:04 devstack sudo[84848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:18:04 devstack sudo[84848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:05 devstack sudo[84848]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.001s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:05 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:05 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Deleted volume successfully. Apr 24 19:18:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6a2787b1-fb24-47f8-999e-4ee95dca4c31 tempest-VolumesActionsTest-1603037564 None] Lock "cinder-6ca347c8-fcc5-4f5e-a837-79fd5356d45c-delete_volume" released by "delete_volume" :: held 4.573s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] Creating offline snapshot 443c91f4-5f1e-448d-a97f-a8bcd9953d44 of volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:06 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa486aaf-5ded-4c97-a72b-441255e2b363]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:07 devstack sudo[84878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:18:07 devstack sudo[84878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:08 devstack sudo[84878]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 1.677s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:08 devstack sudo[84888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 1G Apr 24 19:18:08 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:10 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 1G" returned: 0 in 1.565s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:10 devstack sudo[84935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 Apr 24 19:18:10 devstack sudo[84935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:11 devstack sudo[84935]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44" returned: 0 in 1.471s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:11 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 is being set with open permissions: ugo+rw Apr 24 19:18:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:11 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 Apr 24 19:18:11 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:12 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44" returned: 0 in 1.239s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.334s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:13 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-46bfd5ba-bc93-4b28-862a-f1a2f3b3c1f7 tempest-SnapshotsActionsTest-308656070 None] Create snapshot completed successfully Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-443c91f4-5f1e-448d-a97f-a8bcd9953d44-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-443c91f4-5f1e-448d-a97f-a8bcd9953d44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" acquired by "delete_snapshot" :: waited 0.044s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-quobyte-443c91f4-5f1e-448d-a97f-a8bcd9953d44" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-443c91f4-5f1e-448d-a97f-a8bcd9953d44" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Deleting offline snapshot 443c91f4-5f1e-448d-a97f-a8bcd9953d44 of volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] snapshot_file for this snap is: volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f064290-6e80-428e-8d70-02c79ab88ef7]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:13 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 Apr 24 19:18:13 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:14 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44" returned: 0 in 1.034s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:14 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:14 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbf7307-52bc-4a12-b4ad-a6abc77c1764]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:14 devstack sudo[84958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:18:14 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:15 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 0.806s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:15 devstack sudo[84990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 Apr 24 19:18:15 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:16 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44" returned: 0 in 1.128s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:16 devstack sudo[84995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44 Apr 24 19:18:16 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:17 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:17 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:17 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (996b0f62-8fc5-4977-87c8-c99a75e1714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:17 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531e21a2-e28a-4453-80cd-70cb9bb9c35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.443c91f4-5f1e-448d-a97f-a8bcd9953d44" returned: 0 in 1.318s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:17 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531e21a2-e28a-4453-80cd-70cb9bb9c35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-219154281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a25c66-afa6-4ff9-b5fa-555f2085f409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:18Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c373fc7d-2779-4c32-89c9-2d2b28bbe9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c373fc7d-2779-4c32-89c9-2d2b28bbe9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e44ac25-6635-41f3-bc48-311997b62664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e44ac25-6635-41f3-bc48-311997b62664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a25c66-afa6-4ff9-b5fa-555f2085f409', 'volume_name': 'volume-78a25c66-afa6-4ff9-b5fa-555f2085f409', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0870e21-af44-45e1-9cde-c177b0d3f67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0870e21-af44-45e1-9cde-c177b0d3f67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a928df4-53a7-415b-b47f-6c850d3911b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:18 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Volume 78a25c66-afa6-4ff9-b5fa-555f2085f409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a25c66-afa6-4ff9-b5fa-555f2085f409', 'volume_size': 1} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-219154281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a25c66-afa6-4ff9-b5fa-555f2085f409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:18Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Creating volume 78a25c66-afa6-4ff9-b5fa-555f2085f409 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:18 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-443c91f4-5f1e-448d-a97f-a8bcd9953d44" released by "_delete_snapshot" :: held 4.508s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" released by "delete_snapshot" :: held 4.544s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:18 devstack sudo[85007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409 1073741824 Apr 24 19:18:18 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:18 devstack cinder-volume[81943]: WARNING cinder.quota [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Created reservations ['d193dcac-2a78-4754-bfac-7b18b4e75e77', '78ba8b52-e8cc-466d-964a-1a7156371a16', '854db7c3-4c4a-47bf-9cd9-b4e2dc6c71c1', 'bc419810-d457-43a9-81ee-195b8449d864'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:18 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Delete snapshot completed successfully. Apr 24 19:18:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53942a1c-403e-4670-9b27-47482f26e7d6 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-443c91f4-5f1e-448d-a97f-a8bcd9953d44-delete_snapshot" released by "delete_snapshot" :: held 4.759s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:19 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409 1073741824" returned: 0 in 1.245s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:19 devstack sudo[85040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409 Apr 24 19:18:19 devstack sudo[85040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:20 devstack sudo[85040]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409" returned: 0 in 1.000s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.684s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] Creating offline snapshot 0e471695-41a8-4a05-a1ce-7710b92d65a7 of volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a928df4-53a7-415b-b47f-6c850d3911b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a25c66-afa6-4ff9-b5fa-555f2085f409', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491936e9-c964-47cb-8b25-6ac394762d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b479706e-f2c5-4f91-8914-4f22e59e124f]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:20 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Volume volume-78a25c66-afa6-4ff9-b5fa-555f2085f409 (78a25c66-afa6-4ff9-b5fa-555f2085f409): created successfully Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491936e9-c964-47cb-8b25-6ac394762d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (996b0f62-8fc5-4977-87c8-c99a75e1714e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:20 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-2491bb58-6fb9-4acf-8a0e-a5c8c67d90a8 tempest-VolumesActionsTest-1603037564 None] Created volume successfully. Apr 24 19:18:20 devstack sudo[85050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:18:20 devstack sudo[85050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 0.877s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:21 devstack sudo[85050]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:21 devstack sudo[85057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 1G Apr 24 19:18:21 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Acquiring lock "cinder-78a25c66-afa6-4ff9-b5fa-555f2085f409-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Lock "cinder-78a25c66-afa6-4ff9-b5fa-555f2085f409-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Acquiring lock "cinder-quobyte-78a25c66-afa6-4ff9-b5fa-555f2085f409" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Lock "cinder-quobyte-78a25c66-afa6-4ff9-b5fa-555f2085f409" acquired by "delete_volume" :: waited 0.047s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:21 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[038bf68d-d0fd-4570-b2fd-b23296bdfc1c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:21 devstack sudo[85060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409 Apr 24 19:18:21 devstack sudo[85060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:22 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 1G" returned: 0 in 1.078s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:22 devstack sudo[85065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 Apr 24 19:18:22 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:22 devstack sudo[85060]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409" returned: 0 in 0.739s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:22 devstack sudo[85070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409 Apr 24 19:18:22 devstack sudo[85070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:23 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7" returned: 0 in 0.793s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:23 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 is being set with open permissions: ugo+rw Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:23 devstack sudo[85070]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78a25c66-afa6-4ff9-b5fa-555f2085f409" returned: 0 in 0.621s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:23 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 Apr 24 19:18:23 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Lock "cinder-quobyte-78a25c66-afa6-4ff9-b5fa-555f2085f409" released by "delete_volume" :: held 1.423s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Created reservations ['de564746-ee93-47c7-8267-d745357cd22e', '532b4ee3-728d-44be-a665-21ab18206a35', '0ef9c5bd-969e-42e9-89f2-b42d195c4a7d', '4f19f3ab-a9e5-4387-91ea-8224ed8d0da2'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:23 devstack sudo[85086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:18:23 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:24 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7" returned: 0 in 1.000s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.916s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:24 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.838s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4c3b9370-880c-466c-bedf-1dc44afbe37a tempest-SnapshotsActionsTest-308656070 None] Create snapshot completed successfully Apr 24 19:18:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Deleted volume successfully. Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b060f9a-df18-4717-88f6-2f0b77f45520 tempest-VolumesActionsTest-769729233 None] Lock "cinder-78a25c66-afa6-4ff9-b5fa-555f2085f409-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (dfb5b811-8189-4204-9b55-ea1155d0ed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349c7e5a-e6ad-4447-b797-e7c91fd0f03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349c7e5a-e6ad-4447-b797-e7c91fd0f03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623504844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=346f35a6-c13a-4a14-a129-21a68711ce76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:25Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385a986d-b1ad-4925-ace4-2e344c647636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385a986d-b1ad-4925-ace4-2e344c647636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518a9a51-e903-47f6-9960-ffe3f60142f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518a9a51-e903-47f6-9960-ffe3f60142f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '346f35a6-c13a-4a14-a129-21a68711ce76', 'volume_name': 'volume-346f35a6-c13a-4a14-a129-21a68711ce76', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c04135-1ce7-4598-949d-7ebd492b3908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c04135-1ce7-4598-949d-7ebd492b3908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e27eda-82b0-4ecb-b8bd-0034978e03b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:25 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Volume 346f35a6-c13a-4a14-a129-21a68711ce76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-346f35a6-c13a-4a14-a129-21a68711ce76', 'volume_size': 1} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623504844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=346f35a6-c13a-4a14-a129-21a68711ce76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:25Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Creating volume 346f35a6-c13a-4a14-a129-21a68711ce76 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:25 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:25 devstack sudo[85119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76 1073741824 Apr 24 19:18:25 devstack sudo[85119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-0e471695-41a8-4a05-a1ce-7710b92d65a7-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-0e471695-41a8-4a05-a1ce-7710b92d65a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-quobyte-0e471695-41a8-4a05-a1ce-7710b92d65a7" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-0e471695-41a8-4a05-a1ce-7710b92d65a7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Deleting offline snapshot 0e471695-41a8-4a05-a1ce-7710b92d65a7 of volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] snapshot_file for this snap is: volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa11b24-3c5a-41cb-891e-5d66774a46f9]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:25 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 Apr 24 19:18:25 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:26 devstack sudo[85119]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76 1073741824" returned: 0 in 1.645s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:26 devstack sudo[85141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76 Apr 24 19:18:26 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:27 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7" returned: 0 in 1.826s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:27 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[930d45d2-3e22-4c37-8d52-0e4c859e5bb0]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:27 devstack sudo[85154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:18:27 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:28 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76" returned: 0 in 1.638s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] <== create_volume: return (3396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.400s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e27eda-82b0-4ecb-b8bd-0034978e03b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-346f35a6-c13a-4a14-a129-21a68711ce76', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cc5af5-1749-4781-b84d-c7cd434ba10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:28 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Volume volume-346f35a6-c13a-4a14-a129-21a68711ce76 (346f35a6-c13a-4a14-a129-21a68711ce76): created successfully Apr 24 19:18:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cc5af5-1749-4781-b84d-c7cd434ba10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (dfb5b811-8189-4204-9b55-ea1155d0ed9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d0f6f7ce-c0d2-453b-9b0b-384d69211d86 tempest-VolumesActionsTest-1603037564 None] Created volume successfully. Apr 24 19:18:28 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 1.470s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:28 devstack sudo[85166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 Apr 24 19:18:28 devstack sudo[85166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Acquiring lock "cinder-346f35a6-c13a-4a14-a129-21a68711ce76-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Lock "cinder-346f35a6-c13a-4a14-a129-21a68711ce76-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Acquiring lock "cinder-quobyte-346f35a6-c13a-4a14-a129-21a68711ce76" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Lock "cinder-quobyte-346f35a6-c13a-4a14-a129-21a68711ce76" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:29 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c8a787-cf61-4b7c-ab85-dd0f02a5a554]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:30 devstack sudo[85186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76 Apr 24 19:18:30 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:30 devstack sudo[85166]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7" returned: 0 in 1.393s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:30 devstack sudo[85191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7 Apr 24 19:18:30 devstack sudo[85191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:31 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76" returned: 0 in 1.341s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:31 devstack sudo[85191]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e471695-41a8-4a05-a1ce-7710b92d65a7" returned: 0 in 1.083s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:31 devstack sudo[85199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76 Apr 24 19:18:31 devstack sudo[85199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-0e471695-41a8-4a05-a1ce-7710b92d65a7" released by "_delete_snapshot" :: held 6.001s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" released by "delete_snapshot" :: held 6.046s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:31 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Created reservations ['655f00a2-ac18-4b72-95ba-2cb29dc69441', '8607c229-d451-4174-994d-f6f2a7d9ea50', 'b123da78-b577-474d-8540-5fa5e67907e4', 'eed900ce-9f96-4959-ab58-8eae87c6aab1'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:31 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Delete snapshot completed successfully. Apr 24 19:18:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53da4711-1885-4136-a6c4-581ea0970d61 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-0e471695-41a8-4a05-a1ce-7710b92d65a7-delete_snapshot" released by "delete_snapshot" :: held 6.321s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:32 devstack sudo[85199]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-346f35a6-c13a-4a14-a129-21a68711ce76" returned: 0 in 1.086s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Lock "cinder-quobyte-346f35a6-c13a-4a14-a129-21a68711ce76" released by "delete_volume" :: held 2.522s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] Creating offline snapshot f1939dae-ef24-4497-8294-e6abd87fda95 of volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[59de1635-62f1-4a81-bec5-7edd91681bc1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Created reservations ['d50583c8-3472-4290-ab9c-8d08ed438226', 'c46c25db-d677-4d04-9eca-acdbd88b2d01', '5daf7d38-608b-4350-8e23-bac0e3342a96', '1d82daa8-dfea-4ad2-b75d-90660348d903'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:32 devstack sudo[85204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:18:32 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:32 devstack sudo[85205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:18:32 devstack sudo[85205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:34 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 1.442s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:34 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 1G Apr 24 19:18:34 devstack sudo[85205]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:34 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.315s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:34 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Deleted volume successfully. Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (66119272-549c-49e9-915e-e79678b1b4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa078078-41bb-4a6d-8c33-03c4f802ced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-625def02-8584-451d-a3d9-c6d4c9a4e5bf tempest-VolumesActionsTest-769729233 None] Lock "cinder-346f35a6-c13a-4a14-a129-21a68711ce76-delete_volume" released by "delete_volume" :: held 4.505s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa078078-41bb-4a6d-8c33-03c4f802ced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-785816860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4632333d-7ea3-47a6-a858-d4ef9e0080a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:34Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c635fc-2ea9-4c80-93d4-9de9b8440f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c635fc-2ea9-4c80-93d4-9de9b8440f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf837dff-1853-4d46-b745-9d5b46a87566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf837dff-1853-4d46-b745-9d5b46a87566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4632333d-7ea3-47a6-a858-d4ef9e0080a1', 'volume_name': 'volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6e4e78-0714-4fb0-8319-0016a6f02301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6e4e78-0714-4fb0-8319-0016a6f02301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff8a3c6-a317-4d88-810b-f7befa3e1e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:34 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Volume 4632333d-7ea3-47a6-a858-d4ef9e0080a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1', 'volume_size': 1} Apr 24 19:18:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:35 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 1G" returned: 0 in 1.268s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:35 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 Apr 24 19:18:35 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:35 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95" returned: 0 in 0.641s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:35 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 is being set with open permissions: ugo+rw Apr 24 19:18:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:36 devstack sudo[85268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 Apr 24 19:18:36 devstack sudo[85268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:36 devstack sudo[85268]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95" returned: 0 in 0.701s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.244s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-785816860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4632333d-7ea3-47a6-a858-d4ef9e0080a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:34Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Creating volume 4632333d-7ea3-47a6-a858-d4ef9e0080a1 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:36 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:18:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:36 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b20b3d17-f652-4177-b94d-05a39197424c tempest-SnapshotsActionsTest-308656070 None] Create snapshot completed successfully Apr 24 19:18:36 devstack sudo[85313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1 1073741824 Apr 24 19:18:36 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:37 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1 1073741824" returned: 0 in 0.886s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:37 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1 Apr 24 19:18:37 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-f1939dae-ef24-4497-8294-e6abd87fda95-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-f1939dae-ef24-4497-8294-e6abd87fda95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-quobyte-f1939dae-ef24-4497-8294-e6abd87fda95" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-f1939dae-ef24-4497-8294-e6abd87fda95" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Deleting offline snapshot f1939dae-ef24-4497-8294-e6abd87fda95 of volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] snapshot_file for this snap is: volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a2b16-0335-48d5-a0e3-ad66769ab08e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:38 devstack sudo[85335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 Apr 24 19:18:38 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:38 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1" returned: 0 in 0.726s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff8a3c6-a317-4d88-810b-f7befa3e1e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bfd4d7-716c-4ec9-b1a5-c3f619f0ac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Volume volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1 (4632333d-7ea3-47a6-a858-d4ef9e0080a1): created successfully Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bfd4d7-716c-4ec9-b1a5-c3f619f0ac4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (66119272-549c-49e9-915e-e79678b1b4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:38 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f5291092-4cc3-4391-aa6a-12f9bd35d45c tempest-VolumesActionsTest-1603037564 None] Created volume successfully. Apr 24 19:18:38 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95" returned: 0 in 0.890s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:39 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf5e7f6-7ac8-41ea-b59e-408546de9c42]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:39 devstack sudo[85384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:18:39 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:39 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 0.773s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:39 devstack sudo[85401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 Apr 24 19:18:39 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:39 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Acquiring lock "cinder-4632333d-7ea3-47a6-a858-d4ef9e0080a1-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:39 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Lock "cinder-4632333d-7ea3-47a6-a858-d4ef9e0080a1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Acquiring lock "cinder-quobyte-4632333d-7ea3-47a6-a858-d4ef9e0080a1" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Lock "cinder-quobyte-4632333d-7ea3-47a6-a858-d4ef9e0080a1" acquired by "delete_volume" :: waited 0.087s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3f79c8-ae11-4bd0-8428-260cb629eafd]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:40 devstack sudo[85427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1 Apr 24 19:18:40 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:41 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:18:41 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:41 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95" returned: 0 in 1.905s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:41 devstack sudo[85459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95 Apr 24 19:18:41 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:42 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.445s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:42 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1" returned: 0 in 2.691s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:43 devstack sudo[85467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1 Apr 24 19:18:43 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:44 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.f1939dae-ef24-4497-8294-e6abd87fda95" returned: 0 in 2.330s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-f1939dae-ef24-4497-8294-e6abd87fda95" released by "_delete_snapshot" :: held 6.312s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" released by "delete_snapshot" :: held 6.341s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:44 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Created reservations ['b5cc0dde-24d0-46c7-8112-c656c274068f', 'dbd2e426-ee52-4a9b-9733-1f0dcc437145', '1c04ec93-8ca4-45ae-b295-f3f5d170da10', '5a2c5023-f610-46e9-8f34-d45272ae8359'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:44 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Delete snapshot completed successfully. Apr 24 19:18:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a8b96896-dbc2-44f5-9608-69129dabb1f4 tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-f1939dae-ef24-4497-8294-e6abd87fda95-delete_snapshot" released by "delete_snapshot" :: held 6.818s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:45 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4632333d-7ea3-47a6-a858-d4ef9e0080a1" returned: 0 in 2.355s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Lock "cinder-quobyte-4632333d-7ea3-47a6-a858-d4ef9e0080a1" released by "delete_volume" :: held 5.219s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:45 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Created reservations ['c098f6c3-5e29-45db-9c02-75a89eca7931', 'eeb8811f-2c13-405c-9aea-da06262c56fd', '46a13a31-9a5e-4345-8636-b4530aaba4a9', 'd6aa3b06-aff0-4af9-9b04-2e4e04297618'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:45 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:45 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:46 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:18:46 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] Creating offline snapshot b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 of volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:18:46 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5f0ace-3332-465a-a896-8c3d1a7e5630]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:47 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:18:47 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:48 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 2.220s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:48 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Deleted volume successfully. Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e6326b4f-3d1c-4327-9660-2faee0068430 tempest-VolumesActionsTest-769729233 None] Lock "cinder-4632333d-7ea3-47a6-a858-d4ef9e0080a1-delete_volume" released by "delete_volume" :: held 8.286s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (337aa000-8f59-4238-8809-ad465fa016cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9d97c9-566c-48d8-b576-5794f21d7dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9d97c9-566c-48d8-b576-5794f21d7dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1408470609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d477f0bf-c31b-44d2-9715-cb5784a0f593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:48Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29977ec3-b07a-4848-988a-44f77842f42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29977ec3-b07a-4848-988a-44f77842f42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f877de52-906a-477f-a9a6-2482379942f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f877de52-906a-477f-a9a6-2482379942f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd477f0bf-c31b-44d2-9715-cb5784a0f593', 'volume_name': 'volume-d477f0bf-c31b-44d2-9715-cb5784a0f593', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534612c5-d58c-4a84-8134-543bdaa82adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534612c5-d58c-4a84-8134-543bdaa82adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204287b7-ce99-4136-9cd8-cae8960c6e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:48 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Volume d477f0bf-c31b-44d2-9715-cb5784a0f593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d477f0bf-c31b-44d2-9715-cb5784a0f593', 'volume_size': 1} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:48 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 1.842s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:48 devstack sudo[85511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 1G Apr 24 19:18:48 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-3c1c902f-f02c-46a4-9233-e244efcf62e2 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Terminate volume connection completed successfully. Apr 24 19:18:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-3c1c902f-f02c-46a4-9233-e244efcf62e2 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Deleting attachment b8842ad4-01f3-4e06-9b93-6d0e9b399409. {{(pid=81943) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:18:49 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 1G" returned: 0 in 0.917s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:49 devstack sudo[85516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 Apr 24 19:18:49 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "cinder-d764c1ae-458c-4d5f-af3c-cae195120add-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "cinder-d764c1ae-458c-4d5f-af3c-cae195120add-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "cinder-quobyte-d764c1ae-458c-4d5f-af3c-cae195120add" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "cinder-quobyte-d764c1ae-458c-4d5f-af3c-cae195120add" acquired by "delete_volume" :: waited 0.032s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:50 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[522f907d-59d7-4b7a-bc67-09de09534b44]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:50 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add Apr 24 19:18:50 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:50 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7" returned: 0 in 1.233s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:51 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 is being set with open permissions: ugo+rw Apr 24 19:18:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:51 devstack sudo[85524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 Apr 24 19:18:51 devstack sudo[85524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add" returned: 0 in 1.216s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:52 devstack sudo[85558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add Apr 24 19:18:52 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack sudo[85524]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7" returned: 0 in 1.264s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.578s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.712s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1408470609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d477f0bf-c31b-44d2-9715-cb5784a0f593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:48Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Creating volume d477f0bf-c31b-44d2-9715-cb5784a0f593 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:52 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:18:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-cfaf3496-9b2d-4ad0-87bd-c6a7d222877b tempest-SnapshotsActionsTest-308656070 None] Create snapshot completed successfully Apr 24 19:18:52 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593 1073741824 Apr 24 19:18:52 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:53 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add" returned: 1 in 1.000s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:53 devstack sudo[85567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add Apr 24 19:18:53 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-b4b2e45d-f1fc-4bb6-b653-92c03365d1e7-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-b4b2e45d-f1fc-4bb6-b653-92c03365d1e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:53 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" acquired by "delete_snapshot" :: waited 0.056s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Acquiring lock "cinder-quobyte-b4b2e45d-f1fc-4bb6-b653-92c03365d1e7" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593 1073741824" returned: 0 in 1.315s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:53 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d764c1ae-458c-4d5f-af3c-cae195120add" returned: 0 in 0.718s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-b4b2e45d-f1fc-4bb6-b653-92c03365d1e7" acquired by "_delete_snapshot" :: waited 0.087s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Deleting offline snapshot b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 of volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] snapshot_file for this snap is: volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98a29b8-7b48-4ef3-b401-f85eea987c10]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "cinder-quobyte-d764c1ae-458c-4d5f-af3c-cae195120add" released by "delete_volume" :: held 3.164s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:54 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593 Apr 24 19:18:54 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG cinder.quota [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Created reservations ['ad382b23-fc37-41e8-9bd8-748261b70973', '9500c0a1-fecc-4f5b-b408-c6440999636b', '38fa2e7c-3886-4e92-ba85-7b614e853806', 'f09a3e93-b81d-439b-a946-46fff8b083d2'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:54 devstack sudo[85579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 Apr 24 19:18:54 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:54 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:18:54 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:54 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593" returned: 0 in 0.921s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] <== create_volume: return (2490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.494s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204287b7-ce99-4136-9cd8-cae8960c6e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d477f0bf-c31b-44d2-9715-cb5784a0f593', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee144cb5-0113-4e4e-994b-9b5ffbe1895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:54 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Volume volume-d477f0bf-c31b-44d2-9715-cb5784a0f593 (d477f0bf-c31b-44d2-9715-cb5784a0f593): created successfully Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee144cb5-0113-4e4e-994b-9b5ffbe1895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (337aa000-8f59-4238-8809-ad465fa016cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:54 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b889b55d-f966-4ebe-b670-b4d5d771112f tempest-VolumesActionsTest-1603037564 None] Created volume successfully. Apr 24 19:18:55 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7" returned: 0 in 1.269s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:55 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d96c2b-5b84-48dc-8cdf-7e6963dd5544]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:55 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.024s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:55 devstack cinder-volume[81943]: DEBUG cinder.manager [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:55 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:18:55 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:55 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Deleted volume successfully. Apr 24 19:18:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-1b47449e-037d-4938-aae9-1e62f80ffcd3 req-c92bccf5-506b-4212-aa4f-39d4c83ab5eb tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "cinder-d764c1ae-458c-4d5f-af3c-cae195120add-delete_volume" released by "delete_volume" :: held 4.751s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Acquiring lock "cinder-d477f0bf-c31b-44d2-9715-cb5784a0f593-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Lock "cinder-d477f0bf-c31b-44d2-9715-cb5784a0f593-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:56 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 1.337s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Acquiring lock "cinder-quobyte-d477f0bf-c31b-44d2-9715-cb5784a0f593" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:18:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:56 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 Apr 24 19:18:56 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Lock "cinder-quobyte-d477f0bf-c31b-44d2-9715-cb5784a0f593" acquired by "delete_volume" :: waited 0.091s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:56 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[876b2570-f258-434b-9857-0facb92e358d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:57 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593 Apr 24 19:18:57 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:58 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7" returned: 0 in 1.513s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:58 devstack sudo[85698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7 Apr 24 19:18:58 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:58 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593" returned: 0 in 1.634s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:58 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593 Apr 24 19:18:58 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:59 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.b4b2e45d-f1fc-4bb6-b653-92c03365d1e7" returned: 0 in 1.148s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-b4b2e45d-f1fc-4bb6-b653-92c03365d1e7" released by "_delete_snapshot" :: held 5.504s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" released by "delete_snapshot" :: held 5.602s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Created reservations ['c3f2da65-1f8a-49f8-a145-e2da03d6fa79', '33f447c9-0ff6-440e-9e89-005a234261b8', '742a2d26-ac8a-4c1a-85fe-3bd31d2155c1', '2599782d-3990-446c-9e85-2d55eae6bad7'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:59 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d477f0bf-c31b-44d2-9715-cb5784a0f593" returned: 0 in 1.154s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Lock "cinder-quobyte-d477f0bf-c31b-44d2-9715-cb5784a0f593" released by "delete_volume" :: held 2.873s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:59 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Delete snapshot completed successfully. Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-215f6f82-e7fe-4248-8e1a-849b6b173f4c tempest-SnapshotsActionsTest-1196601678 None] Lock "cinder-b4b2e45d-f1fc-4bb6-b653-92c03365d1e7-delete_snapshot" released by "delete_snapshot" :: held 5.966s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Created reservations ['139bd778-5bfc-4b8f-947d-84a6bebec5f5', '430a9970-3382-4d20-9e0f-257ed2a935ff', 'a22c8664-59c3-4bbc-b2b1-be2c263e5c14', '9f9c9fc4-a2c1-4281-a82a-3afc151488b8'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:59 devstack sudo[85744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:18:59 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:00 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (70c56478-db69-4c00-99fc-10eed718c395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e888dfd-ad37-422a-ac4a-368ddb3be872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e888dfd-ad37-422a-ac4a-368ddb3be872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002279053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c1c05d-f843-444e-8873-97a37b655339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:01Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcbae6c-fd16-4391-94dc-1daa33938153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcbae6c-fd16-4391-94dc-1daa33938153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7535d63a-6d72-481d-bf56-b3874c8319fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7535d63a-6d72-481d-bf56-b3874c8319fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c1c05d-f843-444e-8873-97a37b655339', 'volume_name': 'volume-e3c1c05d-f843-444e-8873-97a37b655339', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f6da79-b9a0-48dc-8d31-79e7bc3b04f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f6da79-b9a0-48dc-8d31-79e7bc3b04f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c885b07-4fc7-4c14-9bb0-b8d19cb81d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:01 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Volume e3c1c05d-f843-444e-8873-97a37b655339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c1c05d-f843-444e-8873-97a37b655339', 'volume_size': 1} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002279053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c1c05d-f843-444e-8873-97a37b655339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf77ac509764a37a02593c22e2ea8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:01Z,use_quota=True,user_id='707451866e794f8e8b09b992dd759613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Creating volume e3c1c05d-f843-444e-8873-97a37b655339 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:01 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:01 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.450s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:01 devstack sudo[85749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339 1073741824 Apr 24 19:19:01 devstack sudo[85749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:01 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Deleted volume successfully. Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-55692f6d-066e-45ce-81b2-e11d8b737a93 tempest-VolumesActionsTest-769729233 None] Lock "cinder-d477f0bf-c31b-44d2-9715-cb5784a0f593-delete_volume" released by "delete_volume" :: held 4.943s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "cinder-0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Lock "cinder-0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" acquired by "delete_snapshot" :: waited 0.048s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "cinder-quobyte-0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Lock "cinder-quobyte-0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Deleting offline snapshot 0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b of volume 136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] snapshot_file for this snap is: volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf336591-6cc2-44af-b383-e96771e48f1c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:01 devstack sudo[85752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:19:01 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:02 devstack sudo[85749]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339 1073741824" returned: 0 in 1.321s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:02 devstack sudo[85759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339 Apr 24 19:19:02 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:02 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 1.328s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:02 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:02 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6588b7-6c09-47dc-90bc-5078eb6ae78a]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:03 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 Apr 24 19:19:03 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Flow 'volume_create_manager' (77c46b02-c991-422a-aee0-9c90f21e2dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84e1dae-4501-47fd-90fe-a226d135dc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84e1dae-4501-47fd-90fe-a226d135dc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1835337587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9505f5c5-c47b-487d-987d-024a210f580a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a850c1a24b4af59c8d15b3c9945fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:04Z,use_quota=True,user_id='7ff735d2d4b8455aa0148989248b0bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:03 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e26441-a7d4-493f-813b-f3ab508b74ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e26441-a7d4-493f-813b-f3ab508b74ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f29e32-fb19-48c5-b552-5753883e3a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f29e32-fb19-48c5-b552-5753883e3a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9505f5c5-c47b-487d-987d-024a210f580a', 'volume_name': 'volume-9505f5c5-c47b-487d-987d-024a210f580a', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae369407-af25-4d16-90ad-539c4d2c80dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae369407-af25-4d16-90ad-539c4d2c80dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b8c61f-0d1f-42d0-ba8b-86e55e592949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:03 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Volume 9505f5c5-c47b-487d-987d-024a210f580a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9505f5c5-c47b-487d-987d-024a210f580a', 'volume_size': 1} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339" returned: 0 in 1.153s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] <== create_volume: return (2619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.623s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1835337587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9505f5c5-c47b-487d-987d-024a210f580a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a850c1a24b4af59c8d15b3c9945fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:04Z,use_quota=True,user_id='7ff735d2d4b8455aa0148989248b0bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Creating volume 9505f5c5-c47b-487d-987d-024a210f580a {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:03 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c885b07-4fc7-4c14-9bb0-b8d19cb81d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c1c05d-f843-444e-8873-97a37b655339', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8c6fc0-56eb-4b57-af4b-b6c89e55ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:03 devstack sudo[85767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a 1073741824 Apr 24 19:19:03 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:03 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Volume volume-e3c1c05d-f843-444e-8873-97a37b655339 (e3c1c05d-f843-444e-8873-97a37b655339): created successfully Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8c6fc0-56eb-4b57-af4b-b6c89e55ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Flow 'volume_create_manager' (70c56478-db69-4c00-99fc-10eed718c395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:03 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-bcd7c416-94c7-442a-b6ce-7b03c45c83fe tempest-VolumesActionsTest-1603037564 None] Created volume successfully. Apr 24 19:19:03 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0" returned: 0 in 1.023s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:03 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:19:03 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:04 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 0.990s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:05 devstack sudo[85779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b Apr 24 19:19:05 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:05 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a 1073741824" returned: 0 in 1.226s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:05 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=92,cinder:SELECT=72,cinder:DELETE=6,cinder:INSERT=14 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:19:05 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=66,cinder:INSERT=31,cinder:UPDATE=88,cinder:DELETE=9 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:19:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:05 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a Apr 24 19:19:05 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Acquiring lock "cinder-e3c1c05d-f843-444e-8873-97a37b655339-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Lock "cinder-e3c1c05d-f843-444e-8873-97a37b655339-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Acquiring lock "cinder-quobyte-e3c1c05d-f843-444e-8873-97a37b655339" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:06 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0.0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" returned: 0 in 1.314s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Lock "cinder-quobyte-e3c1c05d-f843-444e-8873-97a37b655339" acquired by "delete_volume" :: waited 0.049s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:06 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[04554d19-750c-4b80-9486-015aba0cff05]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a" returned: 0 in 1.293s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] <== create_volume: return (2622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.626s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Lock "cinder-quobyte-0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b" released by "_delete_snapshot" :: held 5.098s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" released by "delete_snapshot" :: held 5.200s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b8c61f-0d1f-42d0-ba8b-86e55e592949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9505f5c5-c47b-487d-987d-024a210f580a', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ff9e52-63f6-4e19-982b-5685711d47f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:06 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339 Apr 24 19:19:06 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:06 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Volume volume-9505f5c5-c47b-487d-987d-024a210f580a (9505f5c5-c47b-487d-987d-024a210f580a): created successfully Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ff9e52-63f6-4e19-982b-5685711d47f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Flow 'volume_create_manager' (77c46b02-c991-422a-aee0-9c90f21e2dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:06 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3bae5030-e475-401f-8a42-e670c8b581b0 tempest-ServerRescueNegativeTestJSON-1856157531 None] Created volume successfully. Apr 24 19:19:06 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Created reservations ['7fad903b-5ae4-43d7-b7e4-3ed7e95ba07b', '2a6a4f5f-748c-4a3c-9bb6-2c222e8f0e3e', 'ca950183-57e5-48a0-971d-bde61f42fbfe', '8ee1de31-fc47-4d1d-99b0-c58d991fa775'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:07 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Delete snapshot completed successfully. Apr 24 19:19:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-36c333ec-acfc-46c9-a787-8c33d5c2c3e6 tempest-SnapshotsActionsTest-308656070 None] Lock "cinder-0e1e9c99-6ccc-4924-98c6-c4f6f73bdd1b-delete_snapshot" released by "delete_snapshot" :: held 5.789s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "cinder-136a711e-58aa-4cd2-997a-bbdab4cd93f0-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Lock "cinder-136a711e-58aa-4cd2-997a-bbdab4cd93f0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" acquired by "delete_volume" :: waited 0.029s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:07 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c92f01-5fc9-490e-bf57-5843edf12a93]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:07 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 Apr 24 19:19:07 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:08 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339" returned: 0 in 2.169s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:08 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339 Apr 24 19:19:08 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:09 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0" returned: 0 in 1.691s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:09 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0 Apr 24 19:19:09 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:10 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e3c1c05d-f843-444e-8873-97a37b655339" returned: 0 in 1.523s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Lock "cinder-quobyte-e3c1c05d-f843-444e-8873-97a37b655339" released by "delete_volume" :: held 3.818s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Created reservations ['3e24fbbb-055a-4746-a6fc-8f470c421acb', 'dfede33a-7842-4ff9-92fe-e0f129c07028', 'b8fb6077-47d2-404a-91e3-79865fd38314', '6499d3d0-89e5-4257-9437-1af0b4ee84a0'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:10 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:19:10 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:10 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-23488ded-3312-4548-9bfb-be497c2a7051 req-2a9b9235-4a9d-4ea6-b1c9-68e1c26e3150 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Terminate volume connection completed successfully. Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-23488ded-3312-4548-9bfb-be497c2a7051 req-2a9b9235-4a9d-4ea6-b1c9-68e1c26e3150 tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Deleting attachment 880da856-617d-48a2-95bd-a6eb6eb9b760. {{(pid=81943) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:19:10 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-136a711e-58aa-4cd2-997a-bbdab4cd93f0" returned: 0 in 1.197s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Lock "cinder-quobyte-136a711e-58aa-4cd2-997a-bbdab4cd93f0" released by "delete_volume" :: held 2.979s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Created reservations ['2d704076-68d3-4e34-8fa7-48b3f18df5ff', '1d518711-d7df-44c2-923e-0b200d868c22', '7fa57432-301a-419e-ba64-436c75faf9a2', '736ac9bc-eda9-44cd-9388-c6318b3f85d7'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:10 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:19:10 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:10 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.647s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:10 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:10 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Deleted volume successfully. Apr 24 19:19:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f573869f-7670-400e-97eb-de1a90f23efb tempest-VolumesActionsTest-1603037564 None] Lock "cinder-e3c1c05d-f843-444e-8873-97a37b655339-delete_volume" released by "delete_volume" :: held 4.950s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "cinder-8799876b-df2c-427e-a9c1-852a3c89a9e6-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "cinder-8799876b-df2c-427e-a9c1-852a3c89a9e6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "cinder-quobyte-8799876b-df2c-427e-a9c1-852a3c89a9e6" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "cinder-quobyte-8799876b-df2c-427e-a9c1-852a3c89a9e6" acquired by "delete_volume" :: waited 0.050s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:11 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[5622f512-c7d5-45cd-baa2-babe2700b4bc]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:11 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 Apr 24 19:19:11 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:12 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.750s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:12 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:12 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Deleted volume successfully. Apr 24 19:19:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c63225d-b5ee-4eff-bc54-80a99d2777ab tempest-SnapshotsActionsTest-308656070 None] Lock "cinder-136a711e-58aa-4cd2-997a-bbdab4cd93f0-delete_volume" released by "delete_volume" :: held 5.170s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:13 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6" returned: 0 in 1.833s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:13 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6 Apr 24 19:19:13 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:14 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8799876b-df2c-427e-a9c1-852a3c89a9e6" returned: 0 in 1.053s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "cinder-quobyte-8799876b-df2c-427e-a9c1-852a3c89a9e6" released by "delete_volume" :: held 2.974s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:14 devstack cinder-volume[81943]: DEBUG cinder.quota [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Created reservations ['b066ed25-4839-45f9-aadf-b8fffeb57908', 'f218138f-3f26-4ce0-b9fa-8c852756a0e4', '377ff363-c3e9-440b-9223-e8e6dd5d7c9d', '6fa82506-c0cc-4878-a09f-bf604c3f4901'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:14 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:14 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:14 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:19:14 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:15 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.792s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:15 devstack cinder-volume[81943]: DEBUG cinder.manager [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:15 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Deleted volume successfully. Apr 24 19:19:15 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-23488ded-3312-4548-9bfb-be497c2a7051 req-c1a8500c-ead7-43d4-ad8e-a5d42f6fce5a tempest-ServerBootFromVolumeStableRescueTest-1243301540 None] Lock "cinder-8799876b-df2c-427e-a9c1-852a3c89a9e6-delete_volume" released by "delete_volume" :: held 4.247s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:24 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=22,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:19:25 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=22,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=8 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Flow 'volume_create_manager' (52eeb8cc-70f6-4512-8612-5fe88ba3e234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb68888-c29d-4200-b1af-c73384f87b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb68888-c29d-4200-b1af-c73384f87b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1981158805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e067fb0-6e43-49fc-ab68-77b2d11c3a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6461acb03a5a40d99d688aff36861a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:32Z,use_quota=True,user_id='43cc33e9d3694c50ae0a6fbd937bf80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00f5de6-8bcb-4b43-93e9-902d8a8b8d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00f5de6-8bcb-4b43-93e9-902d8a8b8d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e91ffe-f959-4335-a1cb-1cff657889cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e91ffe-f959-4335-a1cb-1cff657889cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e067fb0-6e43-49fc-ab68-77b2d11c3a0b', 'volume_name': 'volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8179f3f-067d-4a57-b026-7e19c868186f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8179f3f-067d-4a57-b026-7e19c868186f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d220f56a-3f22-428d-8fe2-ef79168ecfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Volume 1e067fb0-6e43-49fc-ab68-77b2d11c3a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b', 'volume_size': 1} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1981158805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e067fb0-6e43-49fc-ab68-77b2d11c3a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6461acb03a5a40d99d688aff36861a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:32Z,use_quota=True,user_id='43cc33e9d3694c50ae0a6fbd937bf80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Creating volume 1e067fb0-6e43-49fc-ab68-77b2d11c3a0b {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:32 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:19:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:32 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b 1073741824 Apr 24 19:19:32 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:33 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b 1073741824" returned: 0 in 1.486s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:33 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b Apr 24 19:19:33 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Acquiring lock "cinder-9505f5c5-c47b-487d-987d-024a210f580a-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Lock "cinder-9505f5c5-c47b-487d-987d-024a210f580a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Acquiring lock "cinder-quobyte-9505f5c5-c47b-487d-987d-024a210f580a" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Lock "cinder-quobyte-9505f5c5-c47b-487d-987d-024a210f580a" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:34 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3522fe0b-c7b8-4878-ab3b-01c8734d413e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:34 devstack sudo[86160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a Apr 24 19:19:34 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:35 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b" returned: 0 in 1.378s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] <== create_volume: return (2958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.962s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d220f56a-3f22-428d-8fe2-ef79168ecfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23e1bc7-9f57-496a-a9d8-d55581e63310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:35 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Volume volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b (1e067fb0-6e43-49fc-ab68-77b2d11c3a0b): created successfully Apr 24 19:19:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23e1bc7-9f57-496a-a9d8-d55581e63310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Flow 'volume_create_manager' (52eeb8cc-70f6-4512-8612-5fe88ba3e234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:35 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-86ce29df-0f12-41cf-b0b4-b84a0c684b39 tempest-VolumeQuotasNegativeTestJSON-491915552 None] Created volume successfully. Apr 24 19:19:36 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a" returned: 0 in 1.347s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:36 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a Apr 24 19:19:36 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:37 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9505f5c5-c47b-487d-987d-024a210f580a" returned: 0 in 1.164s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Lock "cinder-quobyte-9505f5c5-c47b-487d-987d-024a210f580a" released by "delete_volume" :: held 2.606s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:37 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Created reservations ['9ffa7104-c32e-4767-96c3-7ada5d5510c7', 'ed846fb8-d7fa-436e-9f85-0e23f2d6590b', '2251e100-edd1-4ce4-be5c-ee00de31ef3f', '15c407f6-03b9-40df-b155-a6d572750556'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:37 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:19:37 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:38 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.026s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:38 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:38 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Deleted volume successfully. Apr 24 19:19:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Acquiring lock "cinder-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b03ae45a-2e68-4ebf-8a13-e2957d764946 tempest-ServerRescueNegativeTestJSON-1856157531 None] Lock "cinder-9505f5c5-c47b-487d-987d-024a210f580a-delete_volume" released by "delete_volume" :: held 4.311s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Lock "cinder-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Acquiring lock "cinder-quobyte-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Lock "cinder-quobyte-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b" acquired by "delete_volume" :: waited 0.033s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:38 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a2788f-c5d8-46db-976a-4167e1c48007]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:39 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b Apr 24 19:19:39 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:40 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b" returned: 0 in 1.788s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:40 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b Apr 24 19:19:40 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:19:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:40 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:19:40 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:42 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b" returned: 0 in 1.313s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Lock "cinder-quobyte-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b" released by "delete_volume" :: held 3.151s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Created reservations ['46d7962a-e6b6-475f-9c72-45d9880f008d', 'd995ada5-72bb-4171-adfe-bacf390cf1da', '9c09c1d4-3ef3-41a2-9d76-006546d1b8e7', 'd6f235b1-c906-496f-aebe-38d2793db305'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:42 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:42 devstack sudo[86222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:19:42 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.729s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Flow 'volume_create_manager' (bd936922-474c-4b51-a11b-871adf8b426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914d3c36-ebd5-4a83-9458-7225ee207a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914d3c36-ebd5-4a83-9458-7225ee207a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-233302921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d089dbba-3522-4e32-be66-3d197a5d5032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68017b49f4b435b9bf2359142ca2de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:42Z,use_quota=True,user_id='dff589b76c57483f944d6dc202b7b1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291b8c8b-4d76-4266-9114-cf577f237be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291b8c8b-4d76-4266-9114-cf577f237be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33a3fba-124e-4115-964f-060145ff40c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:42 devstack cinder-volume[81943]: DEBUG cinder.image.glance [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Creating Keystone auth plugin from conf {{(pid=81943) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:19:43 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33a3fba-124e-4115-964f-060145ff40c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd089dbba-3522-4e32-be66-3d197a5d5032', 'volume_name': 'volume-d089dbba-3522-4e32-be66-3d197a5d5032', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:43 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572b7dd8-b5ec-43c5-8b98-bf9be9df3690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:43 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572b7dd8-b5ec-43c5-8b98-bf9be9df3690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:43 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67abe584-d9f3-4bb8-a55c-4d609a3d42bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:43 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Volume d089dbba-3522-4e32-be66-3d197a5d5032: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d089dbba-3522-4e32-be66-3d197a5d5032', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:19:43 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Trying to clone d089dbba-3522-4e32-be66-3d197a5d5032 from image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]). {{(pid=81943) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:19:44 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:19:44 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:19:44 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.667s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:44 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:44 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Deleted volume successfully. Apr 24 19:19:44 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e84f16-c3bd-4d63-a6f8-160814b51073]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-18ebc6f5-0dd0-4cd6-9a08-a1e72518709e tempest-VolumeQuotasNegativeTestJSON-491915552 None] Lock "cinder-1e067fb0-6e43-49fc-ab68-77b2d11c3a0b-delete_volume" released by "delete_volume" :: held 5.405s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:44 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD Apr 24 19:19:44 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:45 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD" returned: 0 in 1.562s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:45 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Temporary image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 is fetched for user dff589b76c57483f944d6dc202b7b1de. {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:19:45 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d8f7e4-016f-429b-881f-688f3fa6710f]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:45 devstack sudo[86235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD Apr 24 19:19:45 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:46 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-233302921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d089dbba-3522-4e32-be66-3d197a5d5032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68017b49f4b435b9bf2359142ca2de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:42Z,use_quota=True,user_id='dff589b76c57483f944d6dc202b7b1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Creating volume d089dbba-3522-4e32-be66-3d197a5d5032 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:46 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:19:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:46 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 1073741824 Apr 24 19:19:46 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:47 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 1073741824" returned: 0 in 0.950s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:47 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 Apr 24 19:19:47 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:48 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032" returned: 0 in 0.755s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:48 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Attempting download of 0ac46f6e-0b50-4bf2-95dd-aa609d212809 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}])) to volume d089dbba-3522-4e32-be66-3d197a5d5032. {{(pid=81943) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:19:48 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[555faa9d-9534-42aa-9b3c-a620adf6ec87]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_38m9x8yw {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:48 devstack sudo[86260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_38m9x8yw Apr 24 19:19:48 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:49 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_38m9x8yw" returned: 0 in 0.975s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_38m9x8yw {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:49 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_38m9x8yw Apr 24 19:19:49 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:50 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_38m9x8yw" returned: 1 in 1.020s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_38m9x8yw' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:19:50 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac10f82-404c-46a4-b962-e5d855bf2953]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:50 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD Apr 24 19:19:50 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:51 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] 0ac46f6e-0b50-4bf2-95dd-aa609d212809 was qcow2, converting to raw {{(pid=81943) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:51 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 Apr 24 19:19:51 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Flow 'volume_create_manager' (3e43aed6-b095-4492-999e-914c072f0e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abbf21d-2528-4fc4-9a1d-17e33fa59a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abbf21d-2528-4fc4-9a1d-17e33fa59a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1408234502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985f68b4-0d61-42ef-9552-80cda5774e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76d7e8efa2c4965a7a453669a145c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:51Z,use_quota=True,user_id='faaa8fc75f484e7ba2a2b78267fdcc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(893d9647-fee2-4774-b10a-8c7a918b238f),volume_type_id=893d9647-fee2-4774-b10a-8c7a918b238f)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9907e093-0228-4178-ac58-afb15d9f720f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9907e093-0228-4178-ac58-afb15d9f720f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33fd70d-9df1-47b4-ab14-fa5e35714e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33fd70d-9df1-47b4-ab14-fa5e35714e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '985f68b4-0d61-42ef-9552-80cda5774e23', 'volume_name': 'volume-985f68b4-0d61-42ef-9552-80cda5774e23', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3f7f94-9bff-47a5-8af5-1a28e938044a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3f7f94-9bff-47a5-8af5-1a28e938044a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed98bae1-0f67-4de0-90e5-916471b0653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:51 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Volume 985f68b4-0d61-42ef-9552-80cda5774e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-985f68b4-0d61-42ef-9552-80cda5774e23', 'volume_size': 1} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1408234502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985f68b4-0d61-42ef-9552-80cda5774e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76d7e8efa2c4965a7a453669a145c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:51Z,use_quota=True,user_id='faaa8fc75f484e7ba2a2b78267fdcc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(893d9647-fee2-4774-b10a-8c7a918b238f),volume_type_id=893d9647-fee2-4774-b10a-8c7a918b238f)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Creating volume 985f68b4-0d61-42ef-9552-80cda5774e23 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:51 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:19:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:51 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23 1073741824 Apr 24 19:19:51 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:52 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23 1073741824" returned: 0 in 0.958s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:52 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23 Apr 24 19:19:52 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:53 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23" returned: 0 in 0.769s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed98bae1-0f67-4de0-90e5-916471b0653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985f68b4-0d61-42ef-9552-80cda5774e23', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42911ae7-2bd6-4e71-895a-6836091bae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:53 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032" returned: 0 in 2.070s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:53 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_x4j4e2hjdevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:19:53 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Converted 112.00 MB image at 54.05 MB/s Apr 24 19:19:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:53 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Volume volume-985f68b4-0d61-42ef-9552-80cda5774e23 (985f68b4-0d61-42ef-9552-80cda5774e23): created successfully Apr 24 19:19:53 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 1G Apr 24 19:19:53 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42911ae7-2bd6-4e71-895a-6836091bae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Flow 'volume_create_manager' (3e43aed6-b095-4492-999e-914c072f0e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:53 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-7207bd01-5f74-401c-836d-d806bc05a4eb tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Created volume successfully. Apr 24 19:19:54 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 1G" returned: 0 in 0.666s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:54 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f547b1a7-bfe5-48d0-a687-8c02e93ad738]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:54 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 Apr 24 19:19:54 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:54 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032" returned: 0 in 0.809s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:55 devstack sudo[86323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 Apr 24 19:19:55 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8bf72eda-5618-4b5c-87af-eecc210ba9ea tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8bf72eda-5618-4b5c-87af-eecc210ba9ea tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8bf72eda-5618-4b5c-87af-eecc210ba9ea tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8bf72eda-5618-4b5c-87af-eecc210ba9ea tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8bf72eda-5618-4b5c-87af-eecc210ba9ea tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8bf72eda-5618-4b5c-87af-eecc210ba9ea tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:55 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:19:55 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:55 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032" returned: 1 in 0.931s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Downloaded image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}])) to volume d089dbba-3522-4e32-be66-3d197a5d5032 successfully. {{(pid=81943) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Temporary image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 for user dff589b76c57483f944d6dc202b7b1de is deleted. {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Marking volume d089dbba-3522-4e32-be66-3d197a5d5032 as bootable. {{(pid=81943) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Copying metadata from image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 to d089dbba-3522-4e32-be66-3d197a5d5032. {{(pid=81943) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:19:55 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Creating volume glance metadata for volume d089dbba-3522-4e32-be66-3d197a5d5032 backed by image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81943) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:19:56 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8bf72eda-5618-4b5c-87af-eecc210ba9ea tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.834s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-8bf72eda-5618-4b5c-87af-eecc210ba9ea tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67abe584-d9f3-4bb8-a55c-4d609a3d42bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d089dbba-3522-4e32-be66-3d197a5d5032', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a4bdee-f195-40c7-9fee-12ed66ebbf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-8bf72eda-5618-4b5c-87af-eecc210ba9ea tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Retype volume completed successfully. Apr 24 19:19:56 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Volume volume-d089dbba-3522-4e32-be66-3d197a5d5032 (d089dbba-3522-4e32-be66-3d197a5d5032): created successfully Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a4bdee-f195-40c7-9fee-12ed66ebbf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Flow 'volume_create_manager' (bd936922-474c-4b51-a11b-871adf8b426f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-24bfb2eb-5951-466a-b16d-1d7eea56cca9 tempest-VolumesImageMetadata-454867135 None] Created volume successfully. Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Acquiring lock "cinder-985f68b4-0d61-42ef-9552-80cda5774e23-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "cinder-985f68b4-0d61-42ef-9552-80cda5774e23-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Acquiring lock "cinder-quobyte-985f68b4-0d61-42ef-9552-80cda5774e23" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "cinder-quobyte-985f68b4-0d61-42ef-9552-80cda5774e23" acquired by "delete_volume" :: waited 0.031s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[570837d3-533f-46c5-8cb1-3e78094b4369]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:56 devstack sudo[86331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23 Apr 24 19:19:56 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Acquiring lock "cinder-d089dbba-3522-4e32-be66-3d197a5d5032-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Lock "cinder-d089dbba-3522-4e32-be66-3d197a5d5032-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Acquiring lock "cinder-quobyte-d089dbba-3522-4e32-be66-3d197a5d5032" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Lock "cinder-quobyte-d089dbba-3522-4e32-be66-3d197a5d5032" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:57 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f237a6-5de5-4855-b17e-559d9b24db2f]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:57 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 Apr 24 19:19:57 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:57 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23" returned: 0 in 1.012s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:57 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23 Apr 24 19:19:57 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:58 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032" returned: 0 in 1.003s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:58 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-985f68b4-0d61-42ef-9552-80cda5774e23" returned: 0 in 0.904s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:58 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 Apr 24 19:19:58 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "cinder-quobyte-985f68b4-0d61-42ef-9552-80cda5774e23" released by "delete_volume" :: held 2.021s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:58 devstack cinder-volume[81943]: WARNING cinder.quota [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:19:58 devstack cinder-volume[81943]: WARNING cinder.quota [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Created reservations ['bc30b893-7239-47f1-9c0a-a4ef9e2ec73c', 'eb581a23-fb23-4c6f-bf2b-cfc6a870901a', '7ca0c637-77f0-4c81-be62-6d71c449b26f', 'd287aec4-eb11-4be2-b6f4-b00d4b792b49'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:58 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:19:58 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:59 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032" returned: 1 in 0.941s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:19:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:59 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032 Apr 24 19:19:59 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:59 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.726s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:59 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:59 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Deleted volume successfully. Apr 24 19:19:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-167dd0d5-4457-460e-8690-8a41cbb6e303 tempest-VolumeRetypeWithoutMigrationTest-1697709887 None] Lock "cinder-985f68b4-0d61-42ef-9552-80cda5774e23-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:00 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d089dbba-3522-4e32-be66-3d197a5d5032" returned: 0 in 0.818s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Lock "cinder-quobyte-d089dbba-3522-4e32-be66-3d197a5d5032" released by "delete_volume" :: held 2.839s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:00 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Created reservations ['a6426bfd-8a15-4e7a-b72e-6ecf7728ebfc', '1f80271c-ec7c-48a6-a6c8-292078c6baf2', '71e6ea49-e351-492f-931e-91366dfb4c1a', 'b8e190f6-373d-4d97-aaa2-7dc65465c90f'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:00 devstack sudo[86356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:20:00 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:01 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.870s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:01 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:01 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Deleted volume successfully. Apr 24 19:20:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-99b5499d-b57c-416c-b013-7994270864bc tempest-VolumesImageMetadata-454867135 None] Lock "cinder-d089dbba-3522-4e32-be66-3d197a5d5032-delete_volume" released by "delete_volume" :: held 4.134s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Flow 'volume_create_manager' (71aa85d0-8f5d-4644-a77f-06844a765c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aef8237-2e0a-455a-99b3-35c3e37ed541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aef8237-2e0a-455a-99b3-35c3e37ed541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1525130043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4f662d-6b82-4d18-ac11-751c8855d473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8453d2c1a243e0a19ed34e0e8250ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:09Z,use_quota=True,user_id='27377aa3288c46268c8785abcec45a23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9ce64a-2231-4f69-8111-0e31b2ca941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9ce64a-2231-4f69-8111-0e31b2ca941e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f405be1d-9f72-40b7-b9ee-47054becc5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f405be1d-9f72-40b7-b9ee-47054becc5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4f662d-6b82-4d18-ac11-751c8855d473', 'volume_name': 'volume-db4f662d-6b82-4d18-ac11-751c8855d473', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78115f94-1040-485d-9440-3b2e532016a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78115f94-1040-485d-9440-3b2e532016a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cb0838-1abf-435e-9b9e-fba676c7e530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:09 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Volume db4f662d-6b82-4d18-ac11-751c8855d473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4f662d-6b82-4d18-ac11-751c8855d473', 'volume_size': 1} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1525130043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4f662d-6b82-4d18-ac11-751c8855d473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8453d2c1a243e0a19ed34e0e8250ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:09Z,use_quota=True,user_id='27377aa3288c46268c8785abcec45a23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Creating volume db4f662d-6b82-4d18-ac11-751c8855d473 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:09 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:09 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 1073741824 Apr 24 19:20:09 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:10 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 1073741824" returned: 0 in 0.976s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:10 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 Apr 24 19:20:10 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Flow 'volume_create_manager' (ecc81c5c-5c38-44ab-82a6-187471ccf5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5581ba-5534-46ab-b584-a919fdbbb1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5581ba-5534-46ab-b584-a919fdbbb1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-5017369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8597fe2-5130-4667-92d6-bc7be7d20baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071a8e4b210f4691bc1ba4a480c42eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:11Z,use_quota=True,user_id='edeac4c3b6294d0cab205705a65ae7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111292e7-3207-4e7c-803a-c3b4711c293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111292e7-3207-4e7c-803a-c3b4711c293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22842f8f-2566-4cf8-a32c-0a23da634294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22842f8f-2566-4cf8-a32c-0a23da634294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8597fe2-5130-4667-92d6-bc7be7d20baa', 'volume_name': 'volume-b8597fe2-5130-4667-92d6-bc7be7d20baa', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a83e91-6fe2-4bee-8b62-91e641b7ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a83e91-6fe2-4bee-8b62-91e641b7ab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4819ecf-5159-4a06-9742-c9457fa16152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:11 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Volume b8597fe2-5130-4667-92d6-bc7be7d20baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8597fe2-5130-4667-92d6-bc7be7d20baa', 'volume_size': 1} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:11 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473" returned: 0 in 0.925s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.275s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-5017369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8597fe2-5130-4667-92d6-bc7be7d20baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071a8e4b210f4691bc1ba4a480c42eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:11Z,use_quota=True,user_id='edeac4c3b6294d0cab205705a65ae7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Creating volume b8597fe2-5130-4667-92d6-bc7be7d20baa {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:11 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cb0838-1abf-435e-9b9e-fba676c7e530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4f662d-6b82-4d18-ac11-751c8855d473', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc2db23-18a3-4215-a12b-a0e03210b98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:11 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa 1073741824 Apr 24 19:20:11 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Volume volume-db4f662d-6b82-4d18-ac11-751c8855d473 (db4f662d-6b82-4d18-ac11-751c8855d473): created successfully Apr 24 19:20:11 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc2db23-18a3-4215-a12b-a0e03210b98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Flow 'volume_create_manager' (71aa85d0-8f5d-4644-a77f-06844a765c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:11 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-d4cea6bc-e293-429a-b63f-2bd97a33b232 req-8ff9bfce-e1ed-4b8f-afd2-bd829cc7a2c0 tempest-VolumesSnapshotsTestJSON-170755188 None] Created volume successfully. Apr 24 19:20:12 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa 1073741824" returned: 0 in 0.798s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:12 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa Apr 24 19:20:12 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:12 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Flow 'volume_create_manager' (75314a18-eb58-47da-b299-da0532855d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9dee87-46a8-40b1-9390-5459a07a1504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9dee87-46a8-40b1-9390-5459a07a1504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-6020004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57043f7c-9ab3-407e-8796-9cecbc8531ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47f742b576644669c6dd6f5497b76fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:13Z,use_quota=True,user_id='2ebf4814e707426b82e016218c9a2709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf50ae4-c09b-483d-b981-c2c1cea2d68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf50ae4-c09b-483d-b981-c2c1cea2d68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb8d6de-aab3-4b6e-bccf-09cf04f62cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb8d6de-aab3-4b6e-bccf-09cf04f62cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57043f7c-9ab3-407e-8796-9cecbc8531ce', 'volume_name': 'volume-57043f7c-9ab3-407e-8796-9cecbc8531ce', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdde5d9-3964-47f6-abc6-a09e25cd2f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdde5d9-3964-47f6-abc6-a09e25cd2f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f27f757-2c94-4211-963f-00bf85d0fd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:13 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Volume 57043f7c-9ab3-407e-8796-9cecbc8531ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57043f7c-9ab3-407e-8796-9cecbc8531ce', 'volume_size': 1} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:13 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa" returned: 0 in 0.792s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.287s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-6020004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57043f7c-9ab3-407e-8796-9cecbc8531ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47f742b576644669c6dd6f5497b76fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:13Z,use_quota=True,user_id='2ebf4814e707426b82e016218c9a2709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Creating volume 57043f7c-9ab3-407e-8796-9cecbc8531ce {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:13 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4819ecf-5159-4a06-9742-c9457fa16152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8597fe2-5130-4667-92d6-bc7be7d20baa', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:13 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce 1073741824 Apr 24 19:20:13 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3452ab47-f6d1-4baf-88a4-da61b96945c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:13 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Volume volume-b8597fe2-5130-4667-92d6-bc7be7d20baa (b8597fe2-5130-4667-92d6-bc7be7d20baa): created successfully Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3452ab47-f6d1-4baf-88a4-da61b96945c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Flow 'volume_create_manager' (ecc81c5c-5c38-44ab-82a6-187471ccf5f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:13 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-114b2ea3-2f2e-4cf2-b4ff-7d47d944ac95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Created volume successfully. Apr 24 19:20:14 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce 1073741824" returned: 0 in 0.825s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:14 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce Apr 24 19:20:14 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:14 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce" returned: 0 in 0.611s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.548s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Creating offline snapshot 2cfca0d0-62c7-4c1d-b092-050b90b0d84f of volume db4f662d-6b82-4d18-ac11-751c8855d473 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f27f757-2c94-4211-963f-00bf85d0fd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57043f7c-9ab3-407e-8796-9cecbc8531ce', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e44b0e6a-3541-412e-bb09-688942597e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b8f6bf-365c-4d0f-93d8-b7f310c0a309]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:14 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Volume volume-57043f7c-9ab3-407e-8796-9cecbc8531ce (57043f7c-9ab3-407e-8796-9cecbc8531ce): created successfully Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e44b0e6a-3541-412e-bb09-688942597e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Flow 'volume_create_manager' (75314a18-eb58-47da-b299-da0532855d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:15 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e8de4b9f-e618-4c55-8564-6ecec5ee7c79 tempest-VolumesTransfersV357Test-1698083765 None] Created volume successfully. Apr 24 19:20:15 devstack sudo[86448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 Apr 24 19:20:15 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:15 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473" returned: 0 in 0.598s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:15 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f 1G Apr 24 19:20:15 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:16 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f 1G" returned: 0 in 0.953s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4f662d-6b82-4d18-ac11-751c8855d473 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:16 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4f662d-6b82-4d18-ac11-751c8855d473 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f Apr 24 19:20:16 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:17 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9585a967-e044-4684-8673-19b3414076b8 tempest-VolumesTransfersV357Test-161392741 None] Transfer volume completed successfully. Apr 24 19:20:17 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4f662d-6b82-4d18-ac11-751c8855d473 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f" returned: 0 in 0.999s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:17 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f is being set with open permissions: ugo+rw Apr 24 19:20:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:17 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f Apr 24 19:20:17 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:18 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f" returned: 0 in 0.729s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:18 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.info Apr 24 19:20:18 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Acquiring lock "cinder-57043f7c-9ab3-407e-8796-9cecbc8531ce-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Lock "cinder-57043f7c-9ab3-407e-8796-9cecbc8531ce-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Acquiring lock "cinder-quobyte-57043f7c-9ab3-407e-8796-9cecbc8531ce" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Lock "cinder-quobyte-57043f7c-9ab3-407e-8796-9cecbc8531ce" acquired by "delete_volume" :: waited 0.029s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:18 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98a0dc4-d5da-4161-a33a-8398ffcc3cbd]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:18 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce Apr 24 19:20:18 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:19 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.info" returned: 0 in 0.780s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:19 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.info is being set with open permissions: ugo+rw Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:19 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.info Apr 24 19:20:19 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:19 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce" returned: 0 in 0.718s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:19 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce Apr 24 19:20:19 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:19 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.info" returned: 0 in 0.644s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.865s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.025s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Creating offline snapshot d90bea72-ec6e-4478-82f7-c8d0d13f3cfd of volume b8597fe2-5130-4667-92d6-bc7be7d20baa {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c72c3a4-4d61-4de3-af67-4ef07ab4c875]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:19 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-a526eb9f-2a1e-43c6-9a75-f9373dbb69ee req-8ebb2af0-0bbd-4c1f-b103-b4cc6dd9ad2b tempest-VolumesSnapshotsTestJSON-170755188 None] Create snapshot completed successfully Apr 24 19:20:19 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-57043f7c-9ab3-407e-8796-9cecbc8531ce" returned: 0 in 0.640s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:19 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa Apr 24 19:20:19 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Lock "cinder-quobyte-57043f7c-9ab3-407e-8796-9cecbc8531ce" released by "delete_volume" :: held 1.429s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Created reservations ['e101dfa4-65a4-4e7a-ac36-bbb5cdd3dc88', 'ef5c69a6-c71c-4d70-902d-81771a9a3d3b', '81e9456c-3b3d-4b50-b39b-3178586f3f5f', '2cac806d-eec9-4f68-99dd-47749cbe9c99'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:20 devstack sudo[86526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:20:20 devstack sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Acquiring lock "cinder-2cfca0d0-62c7-4c1d-b092-050b90b0d84f-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "cinder-2cfca0d0-62c7-4c1d-b092-050b90b0d84f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Acquiring lock "cinder-quobyte-db4f662d-6b82-4d18-ac11-751c8855d473" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "cinder-quobyte-db4f662d-6b82-4d18-ac11-751c8855d473" acquired by "delete_snapshot" :: waited 0.036s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Acquiring lock "cinder-quobyte-2cfca0d0-62c7-4c1d-b092-050b90b0d84f" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "cinder-quobyte-2cfca0d0-62c7-4c1d-b092-050b90b0d84f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Deleting offline snapshot 2cfca0d0-62c7-4c1d-b092-050b90b0d84f of volume db4f662d-6b82-4d18-ac11-751c8855d473 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] snapshot_file for this snap is: volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[163fb957-87f9-4fa8-a3e8-f0fa406d3194]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:20 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f Apr 24 19:20:20 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:20 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa" returned: 0 in 0.816s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:20 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd 1G Apr 24 19:20:20 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:21 devstack sudo[86526]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.060s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:21 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Deleted volume successfully. Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34e46a94-922f-4733-b82f-45787f938f74 tempest-VolumesTransfersV357Test-1131268202 None] Lock "cinder-57043f7c-9ab3-407e-8796-9cecbc8531ce-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Flow 'volume_create_manager' (f92b8529-723d-4e21-8ede-e51c0f29b383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e929dbdb-82a9-4689-81f1-3db9a82f6135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e929dbdb-82a9-4689-81f1-3db9a82f6135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1869242574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ea25e1-1d5f-4bbf-b031-731c226fcfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47f742b576644669c6dd6f5497b76fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:22Z,use_quota=True,user_id='2ebf4814e707426b82e016218c9a2709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54e9ea4-6f64-497f-b211-01a4e11f5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54e9ea4-6f64-497f-b211-01a4e11f5e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de10eab6-3718-4414-8d2a-2b505067d311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de10eab6-3718-4414-8d2a-2b505067d311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ea25e1-1d5f-4bbf-b031-731c226fcfd9', 'volume_name': 'volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d4ce7f-0839-434f-996c-0748f767842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d4ce7f-0839-434f-996c-0748f767842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55676daf-6560-4d96-87c3-41bfe894e78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:21 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Volume c4ea25e1-1d5f-4bbf-b031-731c226fcfd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9', 'volume_size': 1} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:21 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f" returned: 0 in 1.338s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db4f662d-6b82-4d18-ac11-751c8855d473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[88edb627-25d3-4602-8057-0fb868f7255a]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:21 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd 1G" returned: 0 in 1.298s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8597fe2-5130-4667-92d6-bc7be7d20baa -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:22 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8597fe2-5130-4667-92d6-bc7be7d20baa -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd Apr 24 19:20:22 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:22 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 Apr 24 19:20:22 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:22 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8597fe2-5130-4667-92d6-bc7be7d20baa -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd" returned: 0 in 0.751s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:22 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd is being set with open permissions: ugo+rw Apr 24 19:20:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:22 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473" returned: 0 in 0.849s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:22 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd Apr 24 19:20:22 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:22 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f Apr 24 19:20:22 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:23 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd" returned: 0 in 0.628s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:23 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.info Apr 24 19:20:23 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:23 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f" returned: 0 in 0.809s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:23 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f Apr 24 19:20:23 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:24 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473.2cfca0d0-62c7-4c1d-b092-050b90b0d84f" returned: 0 in 0.641s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:24 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.info" returned: 0 in 0.827s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:24 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.info is being set with open permissions: ugo+rw Apr 24 19:20:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:24 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.info Apr 24 19:20:24 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "cinder-quobyte-2cfca0d0-62c7-4c1d-b092-050b90b0d84f" released by "_delete_snapshot" :: held 3.793s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "cinder-quobyte-db4f662d-6b82-4d18-ac11-751c8855d473" released by "delete_snapshot" :: held 3.823s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:24 devstack cinder-volume[81943]: DEBUG cinder.quota [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Created reservations ['ac300557-a7d7-4352-bc2d-107cc558cd05', 'f02bfd66-267e-4d38-824c-a41fbae6bd98', '8f65ae52-22c8-4885-9ac6-1ca37ca61c20', 'e0567a3e-995d-42cc-ac8e-ce346c4c24bb'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Delete snapshot completed successfully. Apr 24 19:20:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-2d76cf27-960b-4c99-b5e7-a581f4f39c78 req-2bafb8c5-574f-4aa9-91ed-7677421f8d36 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "cinder-2cfca0d0-62c7-4c1d-b092-050b90b0d84f-delete_snapshot" released by "delete_snapshot" :: held 4.039s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Acquiring lock "cinder-db4f662d-6b82-4d18-ac11-751c8855d473-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "cinder-db4f662d-6b82-4d18-ac11-751c8855d473-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:24 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=75,cinder:SELECT=67,cinder:INSERT=30,cinder:DELETE=2 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Acquiring lock "cinder-quobyte-db4f662d-6b82-4d18-ac11-751c8855d473" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "cinder-quobyte-db4f662d-6b82-4d18-ac11-751c8855d473" acquired by "delete_volume" :: waited 0.024s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:25 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.info" returned: 0 in 0.831s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.294s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[225251a5-c52d-435c-a81a-970e7ac8588b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.224s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1869242574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ea25e1-1d5f-4bbf-b031-731c226fcfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47f742b576644669c6dd6f5497b76fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:22Z,use_quota=True,user_id='2ebf4814e707426b82e016218c9a2709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Creating volume c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:25 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:25 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 1073741824 Apr 24 19:20:25 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:25 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f08a2b8e-a51b-4ac9-b5a0-f6328105bb84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Create snapshot completed successfully Apr 24 19:20:25 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 Apr 24 19:20:25 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:25 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473" returned: 0 in 0.771s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:25 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473 Apr 24 19:20:25 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:26 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 1073741824" returned: 0 in 1.141s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=67,cinder:UPDATE=73,cinder:INSERT=15,cinder:DELETE=11 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Acquiring lock "cinder-d90bea72-ec6e-4478-82f7-c8d0d13f3cfd-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "cinder-d90bea72-ec6e-4478-82f7-c8d0d13f3cfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Acquiring lock "cinder-quobyte-b8597fe2-5130-4667-92d6-bc7be7d20baa" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:26 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 Apr 24 19:20:26 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "cinder-quobyte-b8597fe2-5130-4667-92d6-bc7be7d20baa" acquired by "delete_snapshot" :: waited 0.052s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Acquiring lock "cinder-quobyte-d90bea72-ec6e-4478-82f7-c8d0d13f3cfd" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "cinder-quobyte-d90bea72-ec6e-4478-82f7-c8d0d13f3cfd" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Deleting offline snapshot d90bea72-ec6e-4478-82f7-c8d0d13f3cfd of volume b8597fe2-5130-4667-92d6-bc7be7d20baa {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] snapshot_file for this snap is: volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5b1960-2b3d-4921-94e9-b409d9dbae59]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:26 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd Apr 24 19:20:26 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:26 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-db4f662d-6b82-4d18-ac11-751c8855d473" returned: 0 in 1.042s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "cinder-quobyte-db4f662d-6b82-4d18-ac11-751c8855d473" released by "delete_volume" :: held 1.914s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG cinder.quota [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Created reservations ['52eee7dd-e7e0-4571-be7c-c8ae1b3a9629', '0f7d4edd-4133-406e-943a-0b9a5e5f0861', '0cb36f11-2bda-4dc4-9cd3-4b44d5457fcc', 'be1ed45a-158c-43d8-a73b-c03bb6b82061'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:27 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:20:27 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:27 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9" returned: 0 in 1.245s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] <== create_volume: return (2467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.470s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55676daf-6560-4d96-87c3-41bfe894e78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fd8523-6956-4912-9519-340a21331df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:27 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Volume volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 (c4ea25e1-1d5f-4bbf-b031-731c226fcfd9): created successfully Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fd8523-6956-4912-9519-340a21331df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Flow 'volume_create_manager' (f92b8529-723d-4e21-8ede-e51c0f29b383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:27 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e1e14455-9c33-4e50-bdc4-f8e6e8483c17 tempest-VolumesTransfersV357Test-1698083765 None] Created volume successfully. Apr 24 19:20:27 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd" returned: 0 in 1.172s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8597fe2-5130-4667-92d6-bc7be7d20baa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d527c04-78fc-4028-9bbd-44d5012da5ff]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:28 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa Apr 24 19:20:28 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:28 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.419s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:28 devstack cinder-volume[81943]: DEBUG cinder.manager [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Deleted volume successfully. Apr 24 19:20:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-b7c3fdb9-ebd1-4eb2-9e56-54237f8c5d5d req-ea1ba9aa-dab6-42b7-9d80-eb2386af0ee5 tempest-VolumesSnapshotsTestJSON-170755188 None] Lock "cinder-db4f662d-6b82-4d18-ac11-751c8855d473-delete_volume" released by "delete_volume" :: held 3.854s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Acquiring lock "cinder-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Lock "cinder-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Acquiring lock "cinder-quobyte-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Lock "cinder-quobyte-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9" acquired by "delete_volume" :: waited 0.057s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:29 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[83de40af-f7c0-4994-ab45-224a846a8ca4]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:29 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa" returned: 0 in 1.914s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:29 devstack sudo[86620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd Apr 24 19:20:29 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:29 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 Apr 24 19:20:29 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:30 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9" returned: 0 in 1.220s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:30 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9 Apr 24 19:20:30 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:30 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd" returned: 0 in 1.313s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:31 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd Apr 24 19:20:31 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:31 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa.d90bea72-ec6e-4478-82f7-c8d0d13f3cfd" returned: 0 in 0.570s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:31 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9" returned: 0 in 0.747s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "cinder-quobyte-d90bea72-ec6e-4478-82f7-c8d0d13f3cfd" released by "_delete_snapshot" :: held 5.112s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "cinder-quobyte-b8597fe2-5130-4667-92d6-bc7be7d20baa" released by "delete_snapshot" :: held 5.176s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Lock "cinder-quobyte-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9" released by "delete_volume" :: held 2.031s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Created reservations ['07091a90-dbb2-44e8-98de-03b2ae01b56d', '1af355e1-55c5-410c-abb4-7451ba2ddd2a', '129e9f0d-ff75-4bf7-90b2-2df75a20cddc', '7cad50ed-73b8-4b43-9015-31935f26b14a'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Created reservations ['0aa3ceec-d4fc-4468-9106-149b016fdf28', 'c15151e8-a0c7-4a96-a2d1-b5d8a3bb43cb', 'c5a1cac1-2fc9-4fed-9739-9da3a0fc7d1c', '8df54272-64a3-46cc-992c-751904282f9b'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:31 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:20:31 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:31 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Delete snapshot completed successfully. Apr 24 19:20:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4eff8b3f-242c-49cc-9551-260d55b69d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "cinder-d90bea72-ec6e-4478-82f7-c8d0d13f3cfd-delete_snapshot" released by "delete_snapshot" :: held 5.606s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:32 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.608s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:32 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:32 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Deleted volume successfully. Apr 24 19:20:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d8b5bfee-71c7-470e-a1e7-33580c82481c tempest-VolumesTransfersV357Test-1131268202 None] Lock "cinder-c4ea25e1-1d5f-4bbf-b031-731c226fcfd9-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Acquiring lock "cinder-b8597fe2-5130-4667-92d6-bc7be7d20baa-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "cinder-b8597fe2-5130-4667-92d6-bc7be7d20baa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Acquiring lock "cinder-quobyte-b8597fe2-5130-4667-92d6-bc7be7d20baa" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "cinder-quobyte-b8597fe2-5130-4667-92d6-bc7be7d20baa" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcbc92e-8f20-4e21-b48a-6a1ff3271e79]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:33 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa Apr 24 19:20:33 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Flow 'volume_create_manager' (0b403a81-4706-4296-ab03-be4a390f9072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368130dc-7302-407b-9981-e3068dfd8dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368130dc-7302-407b-9981-e3068dfd8dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1666973040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5816875e-1132-494d-9d5b-f9ca99ecd26d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8376ffa2c4b44efdbe80d8448170f725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:34Z,use_quota=True,user_id='88459e5248ad41e58cd7d41f47e95c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ab4401-9265-44cf-ac57-4939ac1d4ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ab4401-9265-44cf-ac57-4939ac1d4ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448a6075-e49e-4ebc-b3f4-d9e844865049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448a6075-e49e-4ebc-b3f4-d9e844865049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5816875e-1132-494d-9d5b-f9ca99ecd26d', 'volume_name': 'volume-5816875e-1132-494d-9d5b-f9ca99ecd26d', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfc22a6-dd2a-4509-8c8f-fc56dc1b589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfc22a6-dd2a-4509-8c8f-fc56dc1b589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e041e8a-73ff-45bd-a27f-79a136d4bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:33 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Volume 5816875e-1132-494d-9d5b-f9ca99ecd26d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5816875e-1132-494d-9d5b-f9ca99ecd26d', 'volume_size': 1} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1666973040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5816875e-1132-494d-9d5b-f9ca99ecd26d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8376ffa2c4b44efdbe80d8448170f725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:34Z,use_quota=True,user_id='88459e5248ad41e58cd7d41f47e95c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Creating volume 5816875e-1132-494d-9d5b-f9ca99ecd26d {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:33 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:33 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d 1073741824 Apr 24 19:20:33 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:34 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa" returned: 0 in 0.921s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:34 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa Apr 24 19:20:34 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:34 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b8597fe2-5130-4667-92d6-bc7be7d20baa" returned: 0 in 0.724s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "cinder-quobyte-b8597fe2-5130-4667-92d6-bc7be7d20baa" released by "delete_volume" :: held 1.727s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:34 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d 1073741824" returned: 0 in 0.845s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:34 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d Apr 24 19:20:34 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Created reservations ['81859159-e0b2-4b88-bc8a-f64ada375584', 'c66cff52-a840-41f0-8364-612944f3cf0c', 'f786819e-cabf-44ac-8fe2-bb0f5b441816', 'f8a0db65-402d-4503-91ec-f8e3832fec04'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:34 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:35 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:20:35 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:35 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d" returned: 0 in 0.909s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e041e8a-73ff-45bd-a27f-79a136d4bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5816875e-1132-494d-9d5b-f9ca99ecd26d', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a999c43-d6b3-4f2c-90cf-c0232060d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:35 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.781s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:35 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Volume volume-5816875e-1132-494d-9d5b-f9ca99ecd26d (5816875e-1132-494d-9d5b-f9ca99ecd26d): created successfully Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a999c43-d6b3-4f2c-90cf-c0232060d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Flow 'volume_create_manager' (0b403a81-4706-4296-ab03-be4a390f9072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:35 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Deleted volume successfully. Apr 24 19:20:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-68f3eb20-95be-49c5-8acb-916776e495cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1646013029 None] Lock "cinder-b8597fe2-5130-4667-92d6-bc7be7d20baa-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:35 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-4c21eb50-9220-4345-b501-457041f38217 req-d9d03b66-e6e0-4df3-8044-9204f42431b3 tempest-VolumesGetTestJSON-1477941709 None] Created volume successfully. Apr 24 19:20:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Acquiring lock "cinder-5816875e-1132-494d-9d5b-f9ca99ecd26d-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Lock "cinder-5816875e-1132-494d-9d5b-f9ca99ecd26d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Acquiring lock "cinder-quobyte-5816875e-1132-494d-9d5b-f9ca99ecd26d" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Lock "cinder-quobyte-5816875e-1132-494d-9d5b-f9ca99ecd26d" acquired by "delete_volume" :: waited 0.035s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:36 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[018e8bb7-ef6b-4f71-ae56-4b88342e1e81]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:37 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d Apr 24 19:20:37 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:37 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d" returned: 0 in 0.799s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:37 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d Apr 24 19:20:37 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:38 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5816875e-1132-494d-9d5b-f9ca99ecd26d" returned: 0 in 0.814s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Lock "cinder-quobyte-5816875e-1132-494d-9d5b-f9ca99ecd26d" released by "delete_volume" :: held 1.709s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:38 devstack cinder-volume[81943]: DEBUG cinder.quota [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Created reservations ['af45a8da-daea-4d3c-87fe-25b7cb89653b', 'c409534d-5a1b-4e54-9fd6-a74d7eabc135', 'cf461895-f781-4fe0-aa5c-7dcd445ad74c', '708b4b8e-6cf9-44c4-a7ca-9e7a7ab6ed39'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:39 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:20:39 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:40 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.626s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:40 devstack cinder-volume[81943]: DEBUG cinder.manager [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:40 devstack cinder-volume[81943]: INFO cinder.volume.manager [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Deleted volume successfully. Apr 24 19:20:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [req-bd67f506-a61c-4c47-a0b6-708bca01d9d3 req-30b3e55c-df39-48d8-9a69-e1613ef85380 tempest-VolumesGetTestJSON-1477941709 None] Lock "cinder-5816875e-1132-494d-9d5b-f9ca99ecd26d-delete_volume" released by "delete_volume" :: held 3.940s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:20:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:40 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:20:40 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:42 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.136s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Flow 'volume_create_manager' (4548389e-e08e-4d8f-abba-e2e3f906cf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b874c280-e9c2-460a-800d-19015168e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b874c280-e9c2-460a-800d-19015168e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-465052577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29653e5-0fda-44e7-b705-440015a561b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693eaaf9ad5d495987fa025666891bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:47Z,use_quota=True,user_id='a81f0cec9ed04db49ce5dcc02f5fe8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1a5f42-5f19-4ced-9e33-f1a0909af66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1a5f42-5f19-4ced-9e33-f1a0909af66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f090d9-b81c-4b16-8121-ad43cfe27339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f090d9-b81c-4b16-8121-ad43cfe27339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a29653e5-0fda-44e7-b705-440015a561b3', 'volume_name': 'volume-a29653e5-0fda-44e7-b705-440015a561b3', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1641fcb-8763-49ad-94d4-30360d201b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1641fcb-8763-49ad-94d4-30360d201b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5ded59-4875-4ee5-8261-647013d29a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:47 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Volume a29653e5-0fda-44e7-b705-440015a561b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a29653e5-0fda-44e7-b705-440015a561b3', 'volume_size': 1} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-465052577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29653e5-0fda-44e7-b705-440015a561b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693eaaf9ad5d495987fa025666891bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:47Z,use_quota=True,user_id='a81f0cec9ed04db49ce5dcc02f5fe8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Creating volume a29653e5-0fda-44e7-b705-440015a561b3 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:47 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:47 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3 1073741824 Apr 24 19:20:47 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:48 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3 1073741824" returned: 0 in 0.904s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:48 devstack sudo[86800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3 Apr 24 19:20:48 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:49 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3" returned: 0 in 0.703s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5ded59-4875-4ee5-8261-647013d29a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29653e5-0fda-44e7-b705-440015a561b3', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e019b2c-aa1d-4f2c-8214-e48470423b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Volume volume-a29653e5-0fda-44e7-b705-440015a561b3 (a29653e5-0fda-44e7-b705-440015a561b3): created successfully Apr 24 19:20:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e019b2c-aa1d-4f2c-8214-e48470423b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Flow 'volume_create_manager' (4548389e-e08e-4d8f-abba-e2e3f906cf29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-699b1085-d1e0-4d91-a6a9-0c07a102a147 tempest-VolumesTestJSON-287542639 None] Created volume successfully. Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Flow 'volume_create_manager' (2ad9bd14-832a-45c3-a493-f38dfa3f36fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d7e06e-7d7a-4623-b144-f25688082de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d7e06e-7d7a-4623-b144-f25688082de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-205699880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a5db44-e6c3-4440-87d1-7a28df2dce9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693eaaf9ad5d495987fa025666891bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:50Z,use_quota=True,user_id='a81f0cec9ed04db49ce5dcc02f5fe8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8644091-831d-4ed2-a6e1-b5bdde825413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8644091-831d-4ed2-a6e1-b5bdde825413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4ae39e-179a-49fd-8b8a-1c0110ed0afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4ae39e-179a-49fd-8b8a-1c0110ed0afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a5db44-e6c3-4440-87d1-7a28df2dce9a', 'volume_name': 'volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2039ca49-0211-49d2-9cde-0e7647b80f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2039ca49-0211-49d2-9cde-0e7647b80f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3c9a56-5178-402c-9c26-b6d610c32638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:50 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Volume 48a5db44-e6c3-4440-87d1-7a28df2dce9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a', 'volume_size': 1} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-205699880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a5db44-e6c3-4440-87d1-7a28df2dce9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693eaaf9ad5d495987fa025666891bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:50Z,use_quota=True,user_id='a81f0cec9ed04db49ce5dcc02f5fe8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Creating volume 48a5db44-e6c3-4440-87d1-7a28df2dce9a {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:50 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:50 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a 1073741824 Apr 24 19:20:50 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:51 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a 1073741824" returned: 0 in 1.034s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:51 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a Apr 24 19:20:51 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:52 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a" returned: 0 in 0.920s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3c9a56-5178-402c-9c26-b6d610c32638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8f8342-926e-42bc-ba12-610f550f1a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:52 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Volume volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a (48a5db44-e6c3-4440-87d1-7a28df2dce9a): created successfully Apr 24 19:20:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8f8342-926e-42bc-ba12-610f550f1a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Flow 'volume_create_manager' (2ad9bd14-832a-45c3-a493-f38dfa3f36fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-024a7315-ebc5-460f-b046-92e56fec4c0d tempest-VolumesTestJSON-287542639 None] Created volume successfully. Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Flow 'volume_create_manager' (c263cd6e-db5a-424f-811e-d9f05c08fbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e20db63-c463-4215-aad7-cdb7833228f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e20db63-c463-4215-aad7-cdb7833228f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1308625956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33f3978-c783-497b-b7f7-6a08d5181b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6ce78ea12c469e854027098ae11ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:54Z,use_quota=True,user_id='16498c8d6efc4e08bae47c7c1f66e276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52f34f9-5584-4633-bbc3-3335b42e52ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52f34f9-5584-4633-bbc3-3335b42e52ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46272e9-9e17-456f-aea0-3c4c709f95aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46272e9-9e17-456f-aea0-3c4c709f95aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33f3978-c783-497b-b7f7-6a08d5181b74', 'volume_name': 'volume-d33f3978-c783-497b-b7f7-6a08d5181b74', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7230e77-38d3-4609-a7de-244f3df0353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7230e77-38d3-4609-a7de-244f3df0353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c174c9-7746-41e1-98a0-056850861f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Volume d33f3978-c783-497b-b7f7-6a08d5181b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33f3978-c783-497b-b7f7-6a08d5181b74', 'volume_size': 1} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1308625956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33f3978-c783-497b-b7f7-6a08d5181b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6ce78ea12c469e854027098ae11ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:54Z,use_quota=True,user_id='16498c8d6efc4e08bae47c7c1f66e276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Creating volume d33f3978-c783-497b-b7f7-6a08d5181b74 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:54 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:54 devstack sudo[86816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74 1073741824 Apr 24 19:20:54 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Flow 'volume_create_manager' (359a6e3b-7a60-418a-b216-b3b2a5364055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b38c96-3fef-46d9-b490-8cd7aa9ed7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b38c96-3fef-46d9-b490-8cd7aa9ed7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1735857762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c21c229-789b-4089-8868-b429bc245f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119704203cd044339e19915f3bf8fddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:54Z,use_quota=True,user_id='53e220f15df44cb6a07740fdda44321c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53878198-ef1e-4274-8f6f-9bcc05202923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53878198-ef1e-4274-8f6f-9bcc05202923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd7a147-3584-4f88-be48-d777901486d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd7a147-3584-4f88-be48-d777901486d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c21c229-789b-4089-8868-b429bc245f30', 'volume_name': 'volume-6c21c229-789b-4089-8868-b429bc245f30', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d82bcba-c869-44bd-9f9f-2b6b751de85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d82bcba-c869-44bd-9f9f-2b6b751de85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af44749b-0b2e-4ac4-95ee-50e2fd60318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Volume 6c21c229-789b-4089-8868-b429bc245f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c21c229-789b-4089-8868-b429bc245f30', 'volume_size': 1} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Flow 'volume_create_manager' (9f15f5ce-362e-4c3b-9bd5-9ddb821e6d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4628d0-e096-45e5-a7e2-31327a7fca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4628d0-e096-45e5-a7e2-31327a7fca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-854946749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37454011-fb3b-4f31-8850-297eaa413e3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693eaaf9ad5d495987fa025666891bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:55Z,use_quota=True,user_id='a81f0cec9ed04db49ce5dcc02f5fe8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d1b54a-ab3f-47e1-8133-096a920176c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d1b54a-ab3f-47e1-8133-096a920176c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4b243e-3547-4b0b-980a-a2faf4059aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4b243e-3547-4b0b-980a-a2faf4059aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37454011-fb3b-4f31-8850-297eaa413e3b', 'volume_name': 'volume-37454011-fb3b-4f31-8850-297eaa413e3b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066e2510-f8ba-4e51-a6e7-91f124533335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066e2510-f8ba-4e51-a6e7-91f124533335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9f216a-c235-433c-895a-9fd7b43d727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Volume 37454011-fb3b-4f31-8850-297eaa413e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37454011-fb3b-4f31-8850-297eaa413e3b', 'volume_size': 1} Apr 24 19:20:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:55 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74 1073741824" returned: 0 in 0.885s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:55 devstack sudo[86821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74 Apr 24 19:20:55 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:55 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74" returned: 0 in 0.548s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.362s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1735857762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c21c229-789b-4089-8868-b429bc245f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119704203cd044339e19915f3bf8fddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:54Z,use_quota=True,user_id='53e220f15df44cb6a07740fdda44321c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Creating volume 6c21c229-789b-4089-8868-b429bc245f30 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:55 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c174c9-7746-41e1-98a0-056850861f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33f3978-c783-497b-b7f7-6a08d5181b74', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62896743-3ed1-4dfc-8845-8d3c32393ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:55 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30 1073741824 Apr 24 19:20:55 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:55 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Volume volume-d33f3978-c783-497b-b7f7-6a08d5181b74 (d33f3978-c783-497b-b7f7-6a08d5181b74): created successfully Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62896743-3ed1-4dfc-8845-8d3c32393ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Flow 'volume_create_manager' (c263cd6e-db5a-424f-811e-d9f05c08fbe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:55 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-6aa83221-7890-4d82-9e40-c3b4307eb170 tempest-ServersNegativeTestJSON-639089949 None] Created volume successfully. Apr 24 19:20:56 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30 1073741824" returned: 0 in 0.965s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:56 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30 Apr 24 19:20:56 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Flow 'volume_create_manager' (f0d31ca9-7a16-45c9-bf7c-f34323948ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc20bd0-0fb2-492c-9464-1433578f31b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc20bd0-0fb2-492c-9464-1433578f31b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1633912604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2626a5d8249d4c1dba5eb92122cc06bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:57Z,use_quota=True,user_id='7cc01cf4ea8f4af9a52a5746a8b25918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b72ee65-d81a-4d55-89f1-51e6a9cd267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b72ee65-d81a-4d55-89f1-51e6a9cd267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c61761f-596a-4383-88f1-21f453fdad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c61761f-596a-4383-88f1-21f453fdad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad', 'volume_name': 'volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5a4ef7-5d38-43ae-a8ff-c1e7a13577c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5a4ef7-5d38-43ae-a8ff-c1e7a13577c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c73796-85fb-4d79-bbb1-76d73368c49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:56 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Volume b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad', 'volume_size': 1} Apr 24 19:20:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:57 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30" returned: 0 in 0.673s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-854946749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37454011-fb3b-4f31-8850-297eaa413e3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693eaaf9ad5d495987fa025666891bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:55Z,use_quota=True,user_id='a81f0cec9ed04db49ce5dcc02f5fe8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Creating volume 37454011-fb3b-4f31-8850-297eaa413e3b {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:57 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:57 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b 1073741824 Apr 24 19:20:57 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af44749b-0b2e-4ac4-95ee-50e2fd60318b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c21c229-789b-4089-8868-b429bc245f30', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3661b522-4984-44ac-ab73-87ce4dcc3874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:57 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Volume volume-6c21c229-789b-4089-8868-b429bc245f30 (6c21c229-789b-4089-8868-b429bc245f30): created successfully Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3661b522-4984-44ac-ab73-87ce4dcc3874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Flow 'volume_create_manager' (359a6e3b-7a60-418a-b216-b3b2a5364055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:57 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b85a6c40-cc89-47dd-8ebd-939054d98d15 tempest-VolumesListAdminTestJSON-2041828593 None] Created volume successfully. Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Flow 'volume_create_manager' (99c586eb-cc70-41c2-aa1c-53e2b40e09b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5928bc4-edbb-4ff5-892f-39e98e1f9e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5928bc4-edbb-4ff5-892f-39e98e1f9e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-299996985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa93beac-3842-40d2-862a-3a260c6e413b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6ce78ea12c469e854027098ae11ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:58Z,use_quota=True,user_id='16498c8d6efc4e08bae47c7c1f66e276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be9229d-62a4-424a-9931-182126b1add1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be9229d-62a4-424a-9931-182126b1add1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05a3d93-c104-4507-848e-bee00288042c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05a3d93-c104-4507-848e-bee00288042c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa93beac-3842-40d2-862a-3a260c6e413b', 'volume_name': 'volume-aa93beac-3842-40d2-862a-3a260c6e413b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f5728c-a19c-405c-b543-9a3363c27f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f5728c-a19c-405c-b543-9a3363c27f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52108b39-231e-4bdc-8971-e22f00a9a7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:57 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Volume aa93beac-3842-40d2-862a-3a260c6e413b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa93beac-3842-40d2-862a-3a260c6e413b', 'volume_size': 1} Apr 24 19:20:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:58 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b 1073741824" returned: 0 in 0.739s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:58 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b Apr 24 19:20:58 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:58 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b" returned: 0 in 0.561s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1633912604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2626a5d8249d4c1dba5eb92122cc06bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:57Z,use_quota=True,user_id='7cc01cf4ea8f4af9a52a5746a8b25918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Creating volume b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:58 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9f216a-c235-433c-895a-9fd7b43d727a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37454011-fb3b-4f31-8850-297eaa413e3b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2752da-1f2f-4de9-8087-cf49153bcaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:58 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad 1073741824 Apr 24 19:20:58 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:58 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Volume volume-37454011-fb3b-4f31-8850-297eaa413e3b (37454011-fb3b-4f31-8850-297eaa413e3b): created successfully Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2752da-1f2f-4de9-8087-cf49153bcaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Flow 'volume_create_manager' (9f15f5ce-362e-4c3b-9bd5-9ddb821e6d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:58 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-49b0394d-fb4d-432b-b051-ecfa339561ce tempest-VolumesTestJSON-287542639 None] Created volume successfully. Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Flow 'volume_create_manager' (3316b784-83f2-482f-98b7-56815dcb4f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be80c851-e737-439d-9dce-84192ca27f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be80c851-e737-439d-9dce-84192ca27f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1111014323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4e2f58-5127-4b60-bb49-171cb5097beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119704203cd044339e19915f3bf8fddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:59Z,use_quota=True,user_id='53e220f15df44cb6a07740fdda44321c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9d1165-0cb4-46fc-b4a1-39f0ae9c7635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9d1165-0cb4-46fc-b4a1-39f0ae9c7635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd94754a-aae3-40a6-b6d9-913e24f85cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd94754a-aae3-40a6-b6d9-913e24f85cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c4e2f58-5127-4b60-bb49-171cb5097beb', 'volume_name': 'volume-9c4e2f58-5127-4b60-bb49-171cb5097beb', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e3afed-81f7-4ab0-9dc5-1502467cf4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e3afed-81f7-4ab0-9dc5-1502467cf4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635c3e19-d12c-4ab8-9466-5fdd5471a11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:59 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Volume 9c4e2f58-5127-4b60-bb49-171cb5097beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c4e2f58-5127-4b60-bb49-171cb5097beb', 'volume_size': 1} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:59 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad 1073741824" returned: 0 in 0.734s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:59 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad Apr 24 19:20:59 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:00 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" returned: 0 in 0.557s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-299996985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa93beac-3842-40d2-862a-3a260c6e413b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6ce78ea12c469e854027098ae11ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:58Z,use_quota=True,user_id='16498c8d6efc4e08bae47c7c1f66e276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Creating volume aa93beac-3842-40d2-862a-3a260c6e413b {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:00 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c73796-85fb-4d79-bbb1-76d73368c49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02061c9b-b724-469c-93a4-8368ea8c42a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:00 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b 1073741824 Apr 24 19:21:00 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:00 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Volume volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad (b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad): created successfully Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02061c9b-b724-469c-93a4-8368ea8c42a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Flow 'volume_create_manager' (f0d31ca9-7a16-45c9-bf7c-f34323948ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:00 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9ae9a316-5da5-4a02-9fa4-3a96849c1f00 tempest-VolumesActionsTest-2133753489 None] Created volume successfully. Apr 24 19:21:00 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b 1073741824" returned: 0 in 0.740s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:00 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b Apr 24 19:21:00 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Acquiring lock "cinder-37454011-fb3b-4f31-8850-297eaa413e3b-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Lock "cinder-37454011-fb3b-4f31-8850-297eaa413e3b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Acquiring lock "cinder-quobyte-37454011-fb3b-4f31-8850-297eaa413e3b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Lock "cinder-quobyte-37454011-fb3b-4f31-8850-297eaa413e3b" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8467c0-9477-4e52-ab16-93a1f0157a11]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:01 devstack sudo[86858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b Apr 24 19:21:01 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:01 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b" returned: 0 in 0.676s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.456s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1111014323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4e2f58-5127-4b60-bb49-171cb5097beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119704203cd044339e19915f3bf8fddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:59Z,use_quota=True,user_id='53e220f15df44cb6a07740fdda44321c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Creating volume 9c4e2f58-5127-4b60-bb49-171cb5097beb {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:01 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52108b39-231e-4bdc-8971-e22f00a9a7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa93beac-3842-40d2-862a-3a260c6e413b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8f9fda-c51e-415a-9b5c-444671f3c9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:01 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb 1073741824 Apr 24 19:21:01 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:01 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Volume volume-aa93beac-3842-40d2-862a-3a260c6e413b (aa93beac-3842-40d2-862a-3a260c6e413b): created successfully Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8f9fda-c51e-415a-9b5c-444671f3c9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Flow 'volume_create_manager' (99c586eb-cc70-41c2-aa1c-53e2b40e09b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:01 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-06acb695-63f6-422c-8757-3f2372ad5c88 tempest-ServersNegativeTestJSON-639089949 None] Created volume successfully. Apr 24 19:21:02 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b" returned: 0 in 0.860s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:02 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b Apr 24 19:21:02 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Acquiring lock "cinder-aa93beac-3842-40d2-862a-3a260c6e413b-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Lock "cinder-aa93beac-3842-40d2-862a-3a260c6e413b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Acquiring lock "cinder-quobyte-aa93beac-3842-40d2-862a-3a260c6e413b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Lock "cinder-quobyte-aa93beac-3842-40d2-862a-3a260c6e413b" acquired by "delete_volume" :: waited 0.038s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[5671d930-d82f-4a80-9d11-cbc6fe9e94cf]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:02 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb 1073741824" returned: 0 in 1.108s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:02 devstack sudo[86874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b Apr 24 19:21:02 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:02 devstack sudo[86876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb Apr 24 19:21:02 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:02 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-37454011-fb3b-4f31-8850-297eaa413e3b" returned: 0 in 0.795s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Lock "cinder-quobyte-37454011-fb3b-4f31-8850-297eaa413e3b" released by "delete_volume" :: held 1.710s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Created reservations ['bb36ada5-38b8-48ab-ab73-245dcab00f8e', 'a2de238b-cfe0-4c7f-9e26-05682d5037d6', 'a0aecb04-ace3-446c-ac68-d11bbefe408a', 'e14c2343-a6c8-4c56-b6ba-7c518afad727'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:03 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:03 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:03 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b" returned: 0 in 0.710s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:03 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b Apr 24 19:21:03 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Acquiring lock "cinder-48a5db44-e6c3-4440-87d1-7a28df2dce9a-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Lock "cinder-48a5db44-e6c3-4440-87d1-7a28df2dce9a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Acquiring lock "cinder-quobyte-48a5db44-e6c3-4440-87d1-7a28df2dce9a" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:03 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Lock "cinder-quobyte-48a5db44-e6c3-4440-87d1-7a28df2dce9a" acquired by "delete_volume" :: waited 0.033s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb" returned: 0 in 0.875s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c472db8-9649-4925-97ec-b5225c72c3a3]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635c3e19-d12c-4ab8-9466-5fdd5471a11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4e2f58-5127-4b60-bb49-171cb5097beb', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64609546-dbd6-4ad2-b83e-9cce0c7e900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:03 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Volume volume-9c4e2f58-5127-4b60-bb49-171cb5097beb (9c4e2f58-5127-4b60-bb49-171cb5097beb): created successfully Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64609546-dbd6-4ad2-b83e-9cce0c7e900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Flow 'volume_create_manager' (3316b784-83f2-482f-98b7-56815dcb4f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:03 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9588ac08-0b9d-4a10-84c0-ddb4236c9042 tempest-VolumesListAdminTestJSON-2041828593 None] Created volume successfully. Apr 24 19:21:03 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a Apr 24 19:21:03 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:03 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.752s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:03 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Deleted volume successfully. Apr 24 19:21:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d674d0ac-6b22-4742-9048-95d13fc64155 tempest-VolumesTestJSON-287542639 None] Lock "cinder-37454011-fb3b-4f31-8850-297eaa413e3b-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:04 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-aa93beac-3842-40d2-862a-3a260c6e413b" returned: 0 in 0.772s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Lock "cinder-quobyte-aa93beac-3842-40d2-862a-3a260c6e413b" released by "delete_volume" :: held 1.535s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Created reservations ['8936c55a-2ffe-45d4-b8a7-cbbb806eea02', '57fa2085-6a72-4c02-9f66-80b1ea1c5bf9', '832e5435-f034-4089-ae95-4dc739dde3de', 'c2b52e84-e9f6-48f7-9781-35755eaee06c'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:04 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:04 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:04 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a" returned: 0 in 0.790s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:04 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a Apr 24 19:21:04 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Acquiring lock "cinder-d33f3978-c783-497b-b7f7-6a08d5181b74-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Lock "cinder-d33f3978-c783-497b-b7f7-6a08d5181b74-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:04 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.652s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:04 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:04 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Deleted volume successfully. Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Acquiring lock "cinder-quobyte-d33f3978-c783-497b-b7f7-6a08d5181b74" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Lock "cinder-quobyte-d33f3978-c783-497b-b7f7-6a08d5181b74" acquired by "delete_volume" :: waited 0.028s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bede66c4-0072-4a00-bcb4-e999d3fdce53 tempest-ServersNegativeTestJSON-639089949 None] Lock "cinder-aa93beac-3842-40d2-862a-3a260c6e413b-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3586987-792f-4d7d-95a2-8780e405cb4f]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Flow 'volume_create_manager' (473fb179-75ed-4d99-ab7d-63edec82f0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621cf683-12b4-465b-84e3-813fdafbe092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:05 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74 Apr 24 19:21:05 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621cf683-12b4-465b-84e3-813fdafbe092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2034563565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73eb1a48-cb77-49b2-b236-ceb8d98c0319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119704203cd044339e19915f3bf8fddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:05Z,use_quota=True,user_id='53e220f15df44cb6a07740fdda44321c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ce08fd-cf8a-4205-9b29-5ea98084e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ce08fd-cf8a-4205-9b29-5ea98084e245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9017c26-ac34-46e8-8f5b-82efb5b3dc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9017c26-ac34-46e8-8f5b-82efb5b3dc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73eb1a48-cb77-49b2-b236-ceb8d98c0319', 'volume_name': 'volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80227e90-f233-44e7-8c9d-80ffc1b01c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80227e90-f233-44e7-8c9d-80ffc1b01c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51840046-1207-4c99-b13a-2cd7a0ffe251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:05 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Volume 73eb1a48-cb77-49b2-b236-ceb8d98c0319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319', 'volume_size': 1} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2034563565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73eb1a48-cb77-49b2-b236-ceb8d98c0319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119704203cd044339e19915f3bf8fddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:05Z,use_quota=True,user_id='53e220f15df44cb6a07740fdda44321c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Creating volume 73eb1a48-cb77-49b2-b236-ceb8d98c0319 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:05 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:05 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-48a5db44-e6c3-4440-87d1-7a28df2dce9a" returned: 0 in 0.781s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Lock "cinder-quobyte-48a5db44-e6c3-4440-87d1-7a28df2dce9a" released by "delete_volume" :: held 1.650s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:05 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319 1073741824 Apr 24 19:21:05 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Created reservations ['908658ea-a12a-4e9c-8c7c-c589b8061e16', '9b6087be-b016-4917-9a77-f1250fd50d39', '9a3e113b-6128-48da-927c-4668f78dfb44', '64d7fec7-b0d4-49ab-8a1b-2d4956a7418a'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:05 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:05 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:05 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74" returned: 0 in 0.780s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:05 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74 Apr 24 19:21:05 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Acquiring lock "cinder-a29653e5-0fda-44e7-b705-440015a561b3-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Lock "cinder-a29653e5-0fda-44e7-b705-440015a561b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Acquiring lock "cinder-quobyte-a29653e5-0fda-44e7-b705-440015a561b3" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Lock "cinder-quobyte-a29653e5-0fda-44e7-b705-440015a561b3" acquired by "delete_volume" :: waited 0.070s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:06 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.673s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:06 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Deleted volume successfully. Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ede9f5-e735-4fae-8513-fe426018e89a]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-012ee222-feba-421d-8a37-cbfa1a1bfe24 tempest-VolumesTestJSON-287542639 None] Lock "cinder-48a5db44-e6c3-4440-87d1-7a28df2dce9a-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:06 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319 1073741824" returned: 0 in 0.939s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:06 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3 Apr 24 19:21:06 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:06 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319 Apr 24 19:21:06 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:06 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d33f3978-c783-497b-b7f7-6a08d5181b74" returned: 0 in 0.611s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Lock "cinder-quobyte-d33f3978-c783-497b-b7f7-6a08d5181b74" released by "delete_volume" :: held 1.443s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Created reservations ['e312c043-d257-4588-b324-5007fa15ef68', 'ca196a29-ba2e-4869-8504-cde428b4ecd2', 'f6aa6cb5-5b7f-4caa-8185-3cf135787a79', '8ae35345-0d8f-42ff-972e-48b8f9af1fd9'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:06 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:06 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:06 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3" returned: 0 in 0.717s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:06 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:06 devstack sudo[86928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3 Apr 24 19:21:06 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319" returned: 0 in 0.671s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51840046-1207-4c99-b13a-2cd7a0ffe251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f070eb-dc5b-44ea-9c96-b612e8bb4770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:06 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Volume volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319 (73eb1a48-cb77-49b2-b236-ceb8d98c0319): created successfully Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f070eb-dc5b-44ea-9c96-b612e8bb4770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Flow 'volume_create_manager' (473fb179-75ed-4d99-ab7d-63edec82f0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:06 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-ff30e81c-1ec4-44b9-a96c-92a885fcc7f8 tempest-VolumesListAdminTestJSON-2041828593 None] Created volume successfully. Apr 24 19:21:07 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.699s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:07 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:07 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Deleted volume successfully. Apr 24 19:21:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e8606fc5-4b3a-4f55-9314-b67c6b298edf tempest-ServersNegativeTestJSON-639089949 None] Lock "cinder-d33f3978-c783-497b-b7f7-6a08d5181b74-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:07 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a29653e5-0fda-44e7-b705-440015a561b3" returned: 0 in 0.922s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Lock "cinder-quobyte-a29653e5-0fda-44e7-b705-440015a561b3" released by "delete_volume" :: held 1.715s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:07 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Created reservations ['7ed6b194-0638-4dfb-be30-114b2ed24e83', 'bd452573-311b-414e-8611-902acc7c53f5', '8e6a7a1d-2dad-447a-8f66-e7c1eee546eb', 'd721f5f6-852e-4072-96bd-61eb9005bcf9'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:08 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:08 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Flow 'volume_create_manager' (19802257-6399-4a8e-a2a2-2761655976b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc802ba-9a50-4bbd-b580-f086dfc278df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc802ba-9a50-4bbd-b580-f086dfc278df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99307fd5-9d86-453e-9601-91af6a8cb9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48dddc4119243fd913bcf94fc424f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:08Z,use_quota=True,user_id='fd4be5cca7dd41a9a55ef62fca3b6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6078313-12f4-40d6-a108-16a681da85ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6078313-12f4-40d6-a108-16a681da85ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a79548-abea-4f43-90fe-13fb697a1036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a79548-abea-4f43-90fe-13fb697a1036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99307fd5-9d86-453e-9601-91af6a8cb9f6', 'volume_name': 'volume-99307fd5-9d86-453e-9601-91af6a8cb9f6', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6685afb8-4af9-478e-9d17-10e0e36c9987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6685afb8-4af9-478e-9d17-10e0e36c9987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49962929-8d67-4627-8088-3681009b0d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:08 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Volume 99307fd5-9d86-453e-9601-91af6a8cb9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99307fd5-9d86-453e-9601-91af6a8cb9f6', 'volume_size': 1} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99307fd5-9d86-453e-9601-91af6a8cb9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48dddc4119243fd913bcf94fc424f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:08Z,use_quota=True,user_id='fd4be5cca7dd41a9a55ef62fca3b6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Creating volume 99307fd5-9d86-453e-9601-91af6a8cb9f6 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:08 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:21:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:08 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6 1073741824 Apr 24 19:21:08 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:09 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.287s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:09 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:09 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Deleted volume successfully. Apr 24 19:21:09 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-fc65bc32-353c-48b6-85bd-16e5b45e16f0 tempest-VolumesTestJSON-287542639 None] Lock "cinder-a29653e5-0fda-44e7-b705-440015a561b3-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:10 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6 1073741824" returned: 0 in 1.300s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:10 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6 Apr 24 19:21:10 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:10 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6" returned: 0 in 0.674s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:10 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49962929-8d67-4627-8088-3681009b0d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99307fd5-9d86-453e-9601-91af6a8cb9f6', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:10 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbcc3b0-9c40-4eba-9997-4232da921bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:10 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Volume volume-99307fd5-9d86-453e-9601-91af6a8cb9f6 (99307fd5-9d86-453e-9601-91af6a8cb9f6): created successfully Apr 24 19:21:10 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbcc3b0-9c40-4eba-9997-4232da921bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:10 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Flow 'volume_create_manager' (19802257-6399-4a8e-a2a2-2761655976b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:10 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-074f2ca4-8f99-4684-8a5f-27a31250679a tempest-VolumesListAdminTestJSON-886897664 None] Created volume successfully. Apr 24 19:21:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Acquiring lock "cinder-99307fd5-9d86-453e-9601-91af6a8cb9f6-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Lock "cinder-99307fd5-9d86-453e-9601-91af6a8cb9f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Acquiring lock "cinder-quobyte-99307fd5-9d86-453e-9601-91af6a8cb9f6" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Lock "cinder-quobyte-99307fd5-9d86-453e-9601-91af6a8cb9f6" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:11 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6f4391-9910-4d30-8208-2475751cdb59]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "cinder-73eb1a48-cb77-49b2-b236-ceb8d98c0319-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-73eb1a48-cb77-49b2-b236-ceb8d98c0319-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "cinder-quobyte-73eb1a48-cb77-49b2-b236-ceb8d98c0319" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-quobyte-73eb1a48-cb77-49b2-b236-ceb8d98c0319" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:12 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6 Apr 24 19:21:12 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:12 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f5bd1f-9d56-475c-bf59-32f958121419]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:12 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319 Apr 24 19:21:12 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:12 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6" returned: 0 in 0.930s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:12 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6 Apr 24 19:21:12 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:12 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319" returned: 0 in 0.914s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:13 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319 Apr 24 19:21:13 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:13 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-99307fd5-9d86-453e-9601-91af6a8cb9f6" returned: 0 in 0.643s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Lock "cinder-quobyte-99307fd5-9d86-453e-9601-91af6a8cb9f6" released by "delete_volume" :: held 1.640s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Created reservations ['6ae0cf61-8002-492a-9b1e-bf8f53797fd5', '426978cd-f0c1-47eb-8a3f-6470ea9628b1', 'dcd8cb31-1622-43a0-be32-faf19b7376be', '8566d249-320a-4d24-8f96-ab3b08c44e5e'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:13 devstack sudo[87051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:13 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:13 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-73eb1a48-cb77-49b2-b236-ceb8d98c0319" returned: 0 in 0.688s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-quobyte-73eb1a48-cb77-49b2-b236-ceb8d98c0319" released by "delete_volume" :: held 1.659s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Created reservations ['cb45954f-32af-4c43-bb2a-47bc1714b04f', '0824ed39-09ef-4b20-bb37-4da9a51dde31', 'e9573e29-7513-40f7-b2bb-fff9ef9c9ee0', 'a204bbf0-f4e3-44a3-86a4-809e2ad2feac'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:13 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:13 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "cinder-9c4e2f58-5127-4b60-bb49-171cb5097beb-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-9c4e2f58-5127-4b60-bb49-171cb5097beb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:14 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.727s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "cinder-quobyte-9c4e2f58-5127-4b60-bb49-171cb5097beb" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:14 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Deleted volume successfully. Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-quobyte-9c4e2f58-5127-4b60-bb49-171cb5097beb" acquired by "delete_volume" :: waited 0.044s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d13df31-cd39-45dd-8ab6-6c330615b87b tempest-VolumesListAdminTestJSON-886897664 None] Lock "cinder-99307fd5-9d86-453e-9601-91af6a8cb9f6-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2354615-2bfc-415d-a6aa-fb1d6de4deb9]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:14 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb Apr 24 19:21:14 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:14 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.653s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:14 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Deleted volume successfully. Apr 24 19:21:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bb104df3-6ccd-441a-89d2-869fa76509e9 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-73eb1a48-cb77-49b2-b236-ceb8d98c0319-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:15 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-07866d5e-6de7-4b87-a278-dac98762e96a tempest-GroupsTest-1746424654 None] Group tempest-Group1-1739773423: creating Apr 24 19:21:15 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-07866d5e-6de7-4b87-a278-dac98762e96a tempest-GroupsTest-1746424654 None] Group tempest-Group1-1739773423: created successfully Apr 24 19:21:15 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-07866d5e-6de7-4b87-a278-dac98762e96a tempest-GroupsTest-1746424654 None] Create group completed successfully. Apr 24 19:21:15 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb" returned: 0 in 0.681s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:15 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb Apr 24 19:21:15 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:15 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9c4e2f58-5127-4b60-bb49-171cb5097beb" returned: 0 in 0.553s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-quobyte-9c4e2f58-5127-4b60-bb49-171cb5097beb" released by "delete_volume" :: held 1.284s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Created reservations ['8c4122ac-32bf-405b-ae07-d17b5f067e88', 'b47956fe-001d-46ab-a92a-2919179be60e', '29750618-1ce4-46a3-a47a-8ed5f1d1da46', 'b963c5c3-3594-4b9d-a11e-5f08d0c03625'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:15 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:15 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:16 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-183f710d-69cd-4b09-ba8d-0ac948097490 tempest-GroupsTest-1746424654 None] Group tempest-Group2-559961652: creating Apr 24 19:21:16 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-183f710d-69cd-4b09-ba8d-0ac948097490 tempest-GroupsTest-1746424654 None] Group tempest-Group2-559961652: created successfully Apr 24 19:21:16 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-183f710d-69cd-4b09-ba8d-0ac948097490 tempest-GroupsTest-1746424654 None] Create group completed successfully. Apr 24 19:21:16 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.546s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:16 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:16 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Deleted volume successfully. Apr 24 19:21:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f1f91b29-304f-4177-bf69-1bd8a0dfa453 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-9c4e2f58-5127-4b60-bb49-171cb5097beb-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "cinder-6c21c229-789b-4089-8868-b429bc245f30-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-6c21c229-789b-4089-8868-b429bc245f30-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "cinder-quobyte-6c21c229-789b-4089-8868-b429bc245f30" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-quobyte-6c21c229-789b-4089-8868-b429bc245f30" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:16 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0e8eb5-0323-4253-b5a0-10ea5ce05428]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:16 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30 Apr 24 19:21:16 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:17 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30" returned: 0 in 0.796s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:17 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30 Apr 24 19:21:17 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Flow 'volume_create_manager' (bf8073b2-ca9b-4aa5-b45b-9eb95e7eb3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e65d9d-b592-4f54-91ee-f64cf784188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e65d9d-b592-4f54-91ee-f64cf784188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2111407138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60a5be26-8838-4bd4-9ecb-9133fc01c7c3,host='devstack@QuobyteHD#QuobyteHD',id=6d91fd78-6b37-489c-bb03-8742197fcdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f176c7bfe8f6442daa3eddc13fc1b60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:18Z,use_quota=True,user_id='0f06be1a488242edb6c228372b812683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2809e15-65c4-4852-8cd3-6ca3f695798b),volume_type_id=a2809e15-65c4-4852-8cd3-6ca3f695798b)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8dfeff-6873-46dc-b610-de92ced7b552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8dfeff-6873-46dc-b610-de92ced7b552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdb0754-bcaa-4f02-aa7b-bb8afa76ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdb0754-bcaa-4f02-aa7b-bb8afa76ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d91fd78-6b37-489c-bb03-8742197fcdd8', 'volume_name': 'volume-6d91fd78-6b37-489c-bb03-8742197fcdd8', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed323047-4a45-438b-9892-ff2b20b30281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed323047-4a45-438b-9892-ff2b20b30281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ea1348-8e63-42c2-b881-1608a6e394ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:18 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Volume 6d91fd78-6b37-489c-bb03-8742197fcdd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d91fd78-6b37-489c-bb03-8742197fcdd8', 'volume_size': 1} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60a5be26-8838-4bd4-9ecb-9133fc01c7c3,created_at=2026-04-24T17:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2111407138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60a5be26-8838-4bd4-9ecb-9133fc01c7c3,host='devstack@QuobyteHD#QuobyteHD',id=6d91fd78-6b37-489c-bb03-8742197fcdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f176c7bfe8f6442daa3eddc13fc1b60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:18Z,use_quota=True,user_id='0f06be1a488242edb6c228372b812683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2809e15-65c4-4852-8cd3-6ca3f695798b),volume_type_id=a2809e15-65c4-4852-8cd3-6ca3f695798b)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Creating volume 6d91fd78-6b37-489c-bb03-8742197fcdd8 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:18 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:18 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8 1073741824 Apr 24 19:21:18 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:18 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6c21c229-789b-4089-8868-b429bc245f30" returned: 0 in 0.814s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-quobyte-6c21c229-789b-4089-8868-b429bc245f30" released by "delete_volume" :: held 1.691s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Created reservations ['c3fe2fc3-a5aa-4f6e-b1d9-f12a1b129f71', 'bea75ed1-e7af-40eb-bd45-7d3f4e9d4425', '073d2cb1-10bd-4b1e-bf29-f98d27a99b47', '801c5d7f-cc70-41e9-bfc7-6d4c7e912e4d'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:18 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:18 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:19 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8 1073741824" returned: 0 in 1.198s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:19 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8 Apr 24 19:21:19 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:20 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.612s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:20 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:20 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Deleted volume successfully. Apr 24 19:21:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5dab0061-e400-4cbe-b34a-ea08b7a2bd87 tempest-VolumesListAdminTestJSON-2041828593 None] Lock "cinder-6c21c229-789b-4089-8868-b429bc245f30-delete_volume" released by "delete_volume" :: held 3.665s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:20 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8" returned: 0 in 1.124s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.413s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ea1348-8e63-42c2-b881-1608a6e394ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d91fd78-6b37-489c-bb03-8742197fcdd8', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9466465c-8d53-405f-b9ca-2b6fcb239cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:20 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Volume volume-6d91fd78-6b37-489c-bb03-8742197fcdd8 (6d91fd78-6b37-489c-bb03-8742197fcdd8): created successfully Apr 24 19:21:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9466465c-8d53-405f-b9ca-2b6fcb239cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Flow 'volume_create_manager' (bf8073b2-ca9b-4aa5-b45b-9eb95e7eb3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:20 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-925b94ac-8f89-4f9f-ab2f-9daf1e166b9c tempest-GroupsTest-1746424654 None] Created volume successfully. Apr 24 19:21:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Acquiring lock "cinder-quobyte-6d91fd78-6b37-489c-bb03-8742197fcdd8" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Lock "cinder-quobyte-6d91fd78-6b37-489c-bb03-8742197fcdd8" acquired by "delete_volume" :: waited 0.033s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:22 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[749782da-bafa-43d3-9ef7-31fa2ad75c23]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:22 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8 Apr 24 19:21:22 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bf870cd0-d7c9-4b39-873b-8fb7712d5b51 tempest-VolumesActionsTest-2133753489 None] Acquiring lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" by "attach_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bf870cd0-d7c9-4b39-873b-8fb7712d5b51 tempest-VolumesActionsTest-2133753489 None] Lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" acquired by "attach_volume" :: waited 0.063s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:23 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-bf870cd0-d7c9-4b39-873b-8fb7712d5b51 tempest-VolumesActionsTest-2133753489 None] Attaching volume b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad to instance 7d00c4f4-883c-4323-ad5e-8dcf6058a53e at mountpoint /dev/vdb on host None. Apr 24 19:21:23 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-bf870cd0-d7c9-4b39-873b-8fb7712d5b51 tempest-VolumesActionsTest-2133753489 None] Attach volume completed successfully. Apr 24 19:21:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bf870cd0-d7c9-4b39-873b-8fb7712d5b51 tempest-VolumesActionsTest-2133753489 None] Lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" released by "attach_volume" :: held 0.194s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:23 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8" returned: 0 in 1.207s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:23 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8 Apr 24 19:21:23 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1fc30edd-b6ea-42fd-afdd-e80f2ff6e9b9 tempest-VolumesActionsTest-2133753489 None] Acquiring lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad-detach_volume" by "detach_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1fc30edd-b6ea-42fd-afdd-e80f2ff6e9b9 tempest-VolumesActionsTest-2133753489 None] Lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1fc30edd-b6ea-42fd-afdd-e80f2ff6e9b9 tempest-VolumesActionsTest-2133753489 None] Detaching volume b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad from instance 7d00c4f4-883c-4323-ad5e-8dcf6058a53e. Apr 24 19:21:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1fc30edd-b6ea-42fd-afdd-e80f2ff6e9b9 tempest-VolumesActionsTest-2133753489 None] Detach volume completed successfully. Apr 24 19:21:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1fc30edd-b6ea-42fd-afdd-e80f2ff6e9b9 tempest-VolumesActionsTest-2133753489 None] Lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:24 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6d91fd78-6b37-489c-bb03-8742197fcdd8" returned: 0 in 1.037s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Lock "cinder-quobyte-6d91fd78-6b37-489c-bb03-8742197fcdd8" released by "delete_volume" :: held 2.322s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:25 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=114,cinder:UPDATE=143,cinder:INSERT=35,cinder:DELETE=10 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:21:25 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Created reservations ['66f9a588-f1d9-4018-917f-db4cebd80bd8'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:25 devstack cinder-volume[81943]: WARNING cinder.quota [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1852711879 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1852711879, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:21:25 devstack cinder-volume[81943]: WARNING cinder.quota [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1852711879 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1852711879, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:21:25 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Created reservations ['9c3bc8aa-3714-4f9a-9e97-83f3e592b48a', '62a07af3-a523-45ef-8885-2e83d41f843b', '24e93b28-a4df-4c42-8343-32ab4604fcac', '3e1abf6c-f2dc-45bb-b2d0-05d4067c89c2'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:25 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:25 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:26 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=109,cinder:UPDATE=174,cinder:DELETE=16,cinder:INSERT=42 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:21:26 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-415d2c58-5e52-4538-a0a9-9bded1aeff67 tempest-GroupsTest-1746424654 None] Created reservations ['4d62c885-b210-4871-97f9-17053cc4de78'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-415d2c58-5e52-4538-a0a9-9bded1aeff67 tempest-GroupsTest-1746424654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-415d2c58-5e52-4538-a0a9-9bded1aeff67 tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-415d2c58-5e52-4538-a0a9-9bded1aeff67 tempest-GroupsTest-1746424654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-415d2c58-5e52-4538-a0a9-9bded1aeff67 tempest-GroupsTest-1746424654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-415d2c58-5e52-4538-a0a9-9bded1aeff67 tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-415d2c58-5e52-4538-a0a9-9bded1aeff67 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:26 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.031s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:26 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:26 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:26 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:26 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-620ad1ad-d99e-4d29-b5d6-2b276f0e5e00 tempest-GroupsTest-1746424654 None] Delete group completed successfully. Apr 24 19:21:27 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-415d2c58-5e52-4538-a0a9-9bded1aeff67 tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.935s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:27 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-415d2c58-5e52-4538-a0a9-9bded1aeff67 tempest-GroupsTest-1746424654 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:27 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-415d2c58-5e52-4538-a0a9-9bded1aeff67 tempest-GroupsTest-1746424654 None] Delete group completed successfully. Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Flow 'volume_create_manager' (475341b2-0830-4f28-8e19-935c460a4a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9800406e-b86a-4bf7-879d-03c7e1d0e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9800406e-b86a-4bf7-879d-03c7e1d0e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1083166382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c92509a-fddb-4283-9326-861caa79cca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7954620ee0e42958f1c6ac788567b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:28Z,use_quota=True,user_id='4b301da693ef4ad0b2f0b6be0a136329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c635fd6c-4b5a-44f6-ba27-3b17ffb58172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c635fd6c-4b5a-44f6-ba27-3b17ffb58172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2da2b7-8a6a-4987-89be-f8cc772bd012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2da2b7-8a6a-4987-89be-f8cc772bd012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c92509a-fddb-4283-9326-861caa79cca2', 'volume_name': 'volume-8c92509a-fddb-4283-9326-861caa79cca2', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb81032e-b07b-4b5d-9cbb-34e4338a5f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb81032e-b07b-4b5d-9cbb-34e4338a5f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37fc749-9a00-4863-a907-3feaddfa0708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:28 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Volume 8c92509a-fddb-4283-9326-861caa79cca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c92509a-fddb-4283-9326-861caa79cca2', 'volume_size': 1} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1083166382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c92509a-fddb-4283-9326-861caa79cca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7954620ee0e42958f1c6ac788567b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:28Z,use_quota=True,user_id='4b301da693ef4ad0b2f0b6be0a136329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Creating volume 8c92509a-fddb-4283-9326-861caa79cca2 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:28 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:21:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:28 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 1073741824 Apr 24 19:21:28 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-727086a7-e0ab-4b87-a6f1-b3b1ca45aa43 tempest-GroupsTest-1746424654 None] Group tempest-GroupsTest-Group-2050791202: creating Apr 24 19:21:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-727086a7-e0ab-4b87-a6f1-b3b1ca45aa43 tempest-GroupsTest-1746424654 None] Group tempest-GroupsTest-Group-2050791202: created successfully Apr 24 19:21:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-727086a7-e0ab-4b87-a6f1-b3b1ca45aa43 tempest-GroupsTest-1746424654 None] Create group completed successfully. Apr 24 19:21:29 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 1073741824" returned: 0 in 0.986s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:29 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 Apr 24 19:21:29 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:30 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2" returned: 0 in 0.690s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Flow 'volume_create_manager' (cd9900fc-ebc9-4d64-933a-c87c9971c396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d616f0-9c71-47c0-a789-09758b13d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37fc749-9a00-4863-a907-3feaddfa0708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c92509a-fddb-4283-9326-861caa79cca2', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f4ea4b-c75e-4962-b69c-19df70746321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d616f0-9c71-47c0-a789-09758b13d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1389703612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a89f084a-8f21-42d1-b196-3f42d2acd70b,host='devstack@QuobyteHD#QuobyteHD',id=04a19b32-a781-4935-98fa-d08263cffcf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f176c7bfe8f6442daa3eddc13fc1b60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:30Z,use_quota=True,user_id='0f06be1a488242edb6c228372b812683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fcd40a9-097b-4650-92f3-d86eba538db2),volume_type_id=1fcd40a9-097b-4650-92f3-d86eba538db2)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b9bcdc-104a-460b-9328-5f3499af6f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b9bcdc-104a-460b-9328-5f3499af6f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b77711-1d51-4e6a-bfe4-670c75281e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b77711-1d51-4e6a-bfe4-670c75281e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a19b32-a781-4935-98fa-d08263cffcf7', 'volume_name': 'volume-04a19b32-a781-4935-98fa-d08263cffcf7', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95a59ae-2569-4f36-ad4f-24f84e1f15a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95a59ae-2569-4f36-ad4f-24f84e1f15a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d2c03f-1848-43ad-9663-7817f3ca102a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:30 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Volume 04a19b32-a781-4935-98fa-d08263cffcf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a19b32-a781-4935-98fa-d08263cffcf7', 'volume_size': 1} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a89f084a-8f21-42d1-b196-3f42d2acd70b,created_at=2026-04-24T17:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1389703612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a89f084a-8f21-42d1-b196-3f42d2acd70b,host='devstack@QuobyteHD#QuobyteHD',id=04a19b32-a781-4935-98fa-d08263cffcf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f176c7bfe8f6442daa3eddc13fc1b60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:30Z,use_quota=True,user_id='0f06be1a488242edb6c228372b812683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fcd40a9-097b-4650-92f3-d86eba538db2),volume_type_id=1fcd40a9-097b-4650-92f3-d86eba538db2)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Creating volume 04a19b32-a781-4935-98fa-d08263cffcf7 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:30 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:30 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Volume volume-8c92509a-fddb-4283-9326-861caa79cca2 (8c92509a-fddb-4283-9326-861caa79cca2): created successfully Apr 24 19:21:30 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7 1073741824 Apr 24 19:21:30 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f4ea4b-c75e-4962-b69c-19df70746321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Flow 'volume_create_manager' (475341b2-0830-4f28-8e19-935c460a4a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:30 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-21a9beaf-83b7-4ae8-95ba-e49605648e62 tempest-VolumesDeleteCascade-727238206 None] Created volume successfully. Apr 24 19:21:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:31 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7 1073741824" returned: 0 in 0.908s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:31 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7 Apr 24 19:21:31 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:31 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7" returned: 0 in 0.535s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.086s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d2c03f-1848-43ad-9663-7817f3ca102a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a19b32-a781-4935-98fa-d08263cffcf7', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa60975-aba1-43de-9f20-464f76fd155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Creating offline snapshot 555002b2-7332-4ed0-8a7a-7a1b3c44c038 of volume 8c92509a-fddb-4283-9326-861caa79cca2 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:21:31 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Volume volume-04a19b32-a781-4935-98fa-d08263cffcf7 (04a19b32-a781-4935-98fa-d08263cffcf7): created successfully Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa60975-aba1-43de-9f20-464f76fd155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Flow 'volume_create_manager' (cd9900fc-ebc9-4d64-933a-c87c9971c396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf34f94-4082-41b7-99e5-cc739d642f6d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:31 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-91cdc178-9995-461c-a4d5-63a92b77e243 tempest-GroupsTest-1746424654 None] Created volume successfully. Apr 24 19:21:32 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 Apr 24 19:21:32 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:32 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2" returned: 0 in 0.700s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:32 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 1G Apr 24 19:21:32 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:32 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Flow 'volume_create_manager' (083ff3fb-a72c-42c9-9c60-0ffafbdf48e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40c1376-3990-428a-9262-08aae217554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40c1376-3990-428a-9262-08aae217554e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-736437624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a89f084a-8f21-42d1-b196-3f42d2acd70b,host='devstack@QuobyteHD#QuobyteHD',id=5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f176c7bfe8f6442daa3eddc13fc1b60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:33Z,use_quota=True,user_id='0f06be1a488242edb6c228372b812683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fcd40a9-097b-4650-92f3-d86eba538db2),volume_type_id=1fcd40a9-097b-4650-92f3-d86eba538db2)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d57543-ea88-45c6-b661-efeb61327e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d57543-ea88-45c6-b661-efeb61327e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119daa45-3a57-4a9f-b0d2-5d4ce2d417cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119daa45-3a57-4a9f-b0d2-5d4ce2d417cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff', 'volume_name': 'volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94522b4-0770-4f60-9d8b-ae16559de6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94522b4-0770-4f60-9d8b-ae16559de6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f60addb-0f12-48b3-84b6-1e0dfc99d4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:33 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Volume 5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff', 'volume_size': 1} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:33 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 1G" returned: 0 in 0.888s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92509a-fddb-4283-9326-861caa79cca2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:33 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92509a-fddb-4283-9326-861caa79cca2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 Apr 24 19:21:33 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:34 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92509a-fddb-4283-9326-861caa79cca2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038" returned: 0 in 0.644s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:34 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 is being set with open permissions: ugo+rw Apr 24 19:21:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:34 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 Apr 24 19:21:34 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:34 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038" returned: 0 in 0.657s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:34 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.info Apr 24 19:21:34 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:35 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.info" returned: 0 in 0.581s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:35 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.info is being set with open permissions: ugo+rw Apr 24 19:21:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:35 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.info Apr 24 19:21:35 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:36 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.info" returned: 0 in 0.627s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.244s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.043s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a89f084a-8f21-42d1-b196-3f42d2acd70b,created_at=2026-04-24T17:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-736437624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a89f084a-8f21-42d1-b196-3f42d2acd70b,host='devstack@QuobyteHD#QuobyteHD',id=5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f176c7bfe8f6442daa3eddc13fc1b60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:33Z,use_quota=True,user_id='0f06be1a488242edb6c228372b812683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fcd40a9-097b-4650-92f3-d86eba538db2),volume_type_id=1fcd40a9-097b-4650-92f3-d86eba538db2)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Creating volume 5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:36 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:36 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff 1073741824 Apr 24 19:21:36 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:36 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-ce061127-345d-455b-8e07-3e5b44295fbe tempest-VolumesDeleteCascade-727238206 None] Create snapshot completed successfully Apr 24 19:21:36 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff 1073741824" returned: 0 in 0.819s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:37 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff Apr 24 19:21:37 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:37 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff" returned: 0 in 0.668s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.226s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f60addb-0f12-48b3-84b6-1e0dfc99d4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d44852-569c-4104-8c92-cb32a35f1c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] Creating offline snapshot 07571beb-4dbf-4602-85e3-c9ee6956d8ef of volume 8c92509a-fddb-4283-9326-861caa79cca2 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:21:37 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Volume volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff (5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff): created successfully Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d44852-569c-4104-8c92-cb32a35f1c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Flow 'volume_create_manager' (083ff3fb-a72c-42c9-9c60-0ffafbdf48e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3958dc8c-6ab3-4088-a813-147fa68e8159]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:37 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-6272f261-e94e-4a6c-9fd0-7fbd8cc65ab6 tempest-GroupsTest-1746424654 None] Created volume successfully. Apr 24 19:21:37 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 Apr 24 19:21:37 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:38 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038" returned: 0 in 0.686s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c92509a-fddb-4283-9326-861caa79cca2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:38 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef 1G Apr 24 19:21:38 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:38 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-129ec4d7-c04a-4262-ac62-412eaca0b3c5 tempest-GroupsTest-1746424654 None] Update group completed successfully. Apr 24 19:21:39 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef 1G" returned: 0 in 0.844s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:39 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef Apr 24 19:21:39 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:40 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef" returned: 0 in 0.807s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:40 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef is being set with open permissions: ugo+rw Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:40 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef Apr 24 19:21:40 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:40 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b6e727ef-559c-4de9-af2d-ffb80866c9cf tempest-GroupsTest-1746424654 None] Update group completed successfully. Apr 24 19:21:40 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef" returned: 0 in 0.802s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.316s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:40 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:40 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:41 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d27f7f38-727a-4a7a-aa1a-6f33d257e325 tempest-VolumesDeleteCascade-727238206 None] Create snapshot completed successfully Apr 24 19:21:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-8c92509a-fddb-4283-9326-861caa79cca2-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-8c92509a-fddb-4283-9326-861caa79cca2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:41 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.901s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:41 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Performing cascade delete. {{(pid=81943) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 19:21:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-07571beb-4dbf-4602-85e3-c9ee6956d8ef-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-07571beb-4dbf-4602-85e3-c9ee6956d8ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-8c92509a-fddb-4283-9326-861caa79cca2" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Acquiring lock "cinder-quobyte-04a19b32-a781-4935-98fa-d08263cffcf7" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-8c92509a-fddb-4283-9326-861caa79cca2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-07571beb-4dbf-4602-85e3-c9ee6956d8ef" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Lock "cinder-quobyte-04a19b32-a781-4935-98fa-d08263cffcf7" acquired by "delete_volume" :: waited 0.038s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-07571beb-4dbf-4602-85e3-c9ee6956d8ef" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Deleting offline snapshot 07571beb-4dbf-4602-85e3-c9ee6956d8ef of volume 8c92509a-fddb-4283-9326-861caa79cca2 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] snapshot_file for this snap is: volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c53ead1-d354-4c27-a7e0-6042cf926772]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cdc63d-9b17-4975-9ae5-9504bd31f2ec]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:42 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7 Apr 24 19:21:42 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:42 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef Apr 24 19:21:42 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:42 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef" returned: 0 in 0.656s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c92509a-fddb-4283-9326-861caa79cca2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[2518ad68-4f8f-458d-9311-a8ab1038cec0]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:42 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 Apr 24 19:21:42 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:42 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7" returned: 0 in 0.823s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:42 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7 Apr 24 19:21:42 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:43 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038" returned: 0 in 0.720s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:43 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c92509a-fddb-4283-9326-861caa79cca2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:43 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef Apr 24 19:21:43 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:43 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-04a19b32-a781-4935-98fa-d08263cffcf7" returned: 0 in 0.637s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Lock "cinder-quobyte-04a19b32-a781-4935-98fa-d08263cffcf7" released by "delete_volume" :: held 1.523s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Acquiring lock "cinder-quobyte-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Lock "cinder-quobyte-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:43 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf4f389-4cfa-4a82-9bd4-1cd02241bf7d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:43 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff Apr 24 19:21:43 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:44 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef" returned: 0 in 0.733s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:44 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff" returned: 0 in 0.645s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:44 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef Apr 24 19:21:44 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:44 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff Apr 24 19:21:44 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:44 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.07571beb-4dbf-4602-85e3-c9ee6956d8ef" returned: 0 in 0.464s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-07571beb-4dbf-4602-85e3-c9ee6956d8ef" released by "_delete_snapshot" :: held 2.682s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-8c92509a-fddb-4283-9326-861caa79cca2" released by "delete_snapshot" :: held 2.732s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:44 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff" returned: 0 in 0.564s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Created reservations ['bfc698a1-ab3c-45ed-b78c-e02fffe180ad', 'b8684a90-9c18-4211-af78-4a1b3baa3d18', 'a77c529e-d92e-4572-8fa6-4161aa587f20', '6de86502-ea72-458b-a4fb-b657a19b91f5'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Lock "cinder-quobyte-5c92a27c-4fb0-4aa5-b6e6-6efa1fcb84ff" released by "delete_volume" :: held 1.271s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:44 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Delete snapshot completed successfully. Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-07571beb-4dbf-4602-85e3-c9ee6956d8ef-delete_snapshot" released by "delete_snapshot" :: held 2.998s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-555002b2-7332-4ed0-8a7a-7a1b3c44c038-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-555002b2-7332-4ed0-8a7a-7a1b3c44c038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-8c92509a-fddb-4283-9326-861caa79cca2" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Created reservations ['9777b0c1-bf17-4ed8-b63b-7c7aa0040b9c'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-8c92509a-fddb-4283-9326-861caa79cca2" acquired by "delete_snapshot" :: waited 0.037s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-555002b2-7332-4ed0-8a7a-7a1b3c44c038" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-555002b2-7332-4ed0-8a7a-7a1b3c44c038" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Deleting offline snapshot 555002b2-7332-4ed0-8a7a-7a1b3c44c038 of volume 8c92509a-fddb-4283-9326-861caa79cca2 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] snapshot_file for this snap is: volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38c0c11-b261-48f3-961f-7a9166e5b5f7]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:45 devstack cinder-volume[81943]: WARNING cinder.quota [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-565075489 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-565075489, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:21:45 devstack cinder-volume[81943]: WARNING cinder.quota [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-565075489 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-565075489, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Created reservations ['a5ff42fb-7fce-4ca8-99e6-77be83b5c7a7', '35177cc5-cf1f-4c3e-812d-bcf07875eca3', 'a48b7bd1-ccc6-4be1-a7c0-a82b6d791b4c', 'f42371dc-3418-4f2e-b7e8-a0528194ae94'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:45 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 Apr 24 19:21:45 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Created reservations ['93bb5b36-dbea-4b8b-9dcd-45d3196d9c3d', 'f949fd71-2125-43a9-8a8a-b1376c587b4e', '32c12587-b1b0-455e-90dc-83fec310c791', '1b7e7164-70c9-428c-8ece-73530a53b013'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:45 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:45 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:45 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038" returned: 0 in 0.711s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c92509a-fddb-4283-9326-861caa79cca2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3ed1cc-aea8-4be5-8113-1923ff262c72]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:46 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 Apr 24 19:21:46 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:46 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.547s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:46 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:46 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-95d1e6ab-e6c8-41bc-864b-575f51902ab1 tempest-GroupsTest-1746424654 None] Delete group completed successfully. Apr 24 19:21:46 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2" returned: 0 in 0.731s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:46 devstack sudo[87342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 Apr 24 19:21:46 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:47 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038" returned: 0 in 0.908s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:47 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038 Apr 24 19:21:47 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:48 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2.555002b2-7332-4ed0-8a7a-7a1b3c44c038" returned: 0 in 1.067s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-555002b2-7332-4ed0-8a7a-7a1b3c44c038" released by "_delete_snapshot" :: held 3.607s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-8c92509a-fddb-4283-9326-861caa79cca2" released by "delete_snapshot" :: held 3.663s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:48 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Created reservations ['e81fb702-60c3-49ab-8224-1166532ba01c', 'cd11c4ab-cac1-4d0d-8e28-dc426e5cfaf8', '351eeba7-3c65-4bc3-8b97-6123c3a55615', 'c1cf6206-060e-4e92-ab63-396a3e9b4da2'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:48 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Delete snapshot completed successfully. Apr 24 19:21:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-555002b2-7332-4ed0-8a7a-7a1b3c44c038-delete_snapshot" released by "delete_snapshot" :: held 4.061s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Snapshots deleted, issuing volume delete {{(pid=81943) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 19:21:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-8c92509a-fddb-4283-9326-861caa79cca2" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-8c92509a-fddb-4283-9326-861caa79cca2" acquired by "delete_volume" :: waited 0.049s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:49 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea27c93-4223-41aa-a9e8-42c803694fe6]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:49 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 Apr 24 19:21:49 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:50 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2" returned: 0 in 1.197s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:50 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2 Apr 24 19:21:50 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:51 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c92509a-fddb-4283-9326-861caa79cca2" returned: 0 in 0.994s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-8c92509a-fddb-4283-9326-861caa79cca2" released by "delete_volume" :: held 2.333s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-43d8264f-85f2-4025-b5e5-2cbd613c90fe tempest-VolumesActionsTest-2133753489 None] Acquiring lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" by "attach_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Created reservations ['ae57fa52-9875-4168-8a7b-e4a1431bc5be', '4cf00301-a127-4711-bd3b-55efe8144235', '3af7d108-109a-45b8-8c71-4977ae6010a8', 'ecd450f8-e5ec-4c37-98c8-80f9bed8d1e4'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-43d8264f-85f2-4025-b5e5-2cbd613c90fe tempest-VolumesActionsTest-2133753489 None] Lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" acquired by "attach_volume" :: waited 0.084s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:51 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-43d8264f-85f2-4025-b5e5-2cbd613c90fe tempest-VolumesActionsTest-2133753489 None] Attaching volume b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad to instance abfa2109-8afa-4758-8e4c-c7cd611b86af at mountpoint /dev/vdb on host None. Apr 24 19:21:51 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-43d8264f-85f2-4025-b5e5-2cbd613c90fe tempest-VolumesActionsTest-2133753489 None] Attach volume completed successfully. Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-43d8264f-85f2-4025-b5e5-2cbd613c90fe tempest-VolumesActionsTest-2133753489 None] Lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" released by "attach_volume" :: held 0.277s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:52 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:21:52 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd59eee9-a3e8-42ba-871f-944d36bb1482 tempest-VolumesActionsTest-2133753489 None] Acquiring lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad-detach_volume" by "detach_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd59eee9-a3e8-42ba-871f-944d36bb1482 tempest-VolumesActionsTest-2133753489 None] Lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-dd59eee9-a3e8-42ba-871f-944d36bb1482 tempest-VolumesActionsTest-2133753489 None] Detaching volume b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad from instance abfa2109-8afa-4758-8e4c-c7cd611b86af. Apr 24 19:21:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-dd59eee9-a3e8-42ba-871f-944d36bb1482 tempest-VolumesActionsTest-2133753489 None] Detach volume completed successfully. Apr 24 19:21:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd59eee9-a3e8-42ba-871f-944d36bb1482 tempest-VolumesActionsTest-2133753489 None] Lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:53 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.351s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:53 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:53 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Deleted volume successfully. Apr 24 19:21:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-668a4b36-4521-44e1-8612-0740fd9cc956 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-8c92509a-fddb-4283-9326-861caa79cca2-delete_volume" released by "delete_volume" :: held 11.560s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:53 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Flow 'volume_create_manager' (6423e06b-b5a6-40d9-bacb-e20ab70e2cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa0f57b-7702-4a13-8af3-69c6a9448c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa0f57b-7702-4a13-8af3-69c6a9448c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-798073200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c261949-0623-4799-83f7-94435e969b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7954620ee0e42958f1c6ac788567b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:54Z,use_quota=True,user_id='4b301da693ef4ad0b2f0b6be0a136329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eba1fdf-a15c-485d-bd22-c1d1b3874ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eba1fdf-a15c-485d-bd22-c1d1b3874ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdccb6f-ff68-4f36-87e7-79a1d61d63f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdccb6f-ff68-4f36-87e7-79a1d61d63f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c261949-0623-4799-83f7-94435e969b78', 'volume_name': 'volume-3c261949-0623-4799-83f7-94435e969b78', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ae5c2c-33fd-4c34-a4f2-ffea28e93d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ae5c2c-33fd-4c34-a4f2-ffea28e93d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e19de6-502e-45ff-bfc1-c56664616452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:54 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Volume 3c261949-0623-4799-83f7-94435e969b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c261949-0623-4799-83f7-94435e969b78', 'volume_size': 1} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-798073200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c261949-0623-4799-83f7-94435e969b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7954620ee0e42958f1c6ac788567b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:54Z,use_quota=True,user_id='4b301da693ef4ad0b2f0b6be0a136329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Creating volume 3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:54 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:21:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:54 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 1073741824 Apr 24 19:21:54 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:55 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 1073741824" returned: 0 in 1.314s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:55 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 Apr 24 19:21:55 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:56 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78" returned: 0 in 0.843s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.229s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e19de6-502e-45ff-bfc1-c56664616452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c261949-0623-4799-83f7-94435e969b78', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558775a7-d9f0-4e8e-8e91-e9d10475683d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:56 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Volume volume-3c261949-0623-4799-83f7-94435e969b78 (3c261949-0623-4799-83f7-94435e969b78): created successfully Apr 24 19:21:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558775a7-d9f0-4e8e-8e91-e9d10475683d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Flow 'volume_create_manager' (6423e06b-b5a6-40d9-bacb-e20ab70e2cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e8a2e662-e701-4f9c-a06d-9676bad8f7f1 tempest-VolumesDeleteCascade-727238206 None] Created volume successfully. Apr 24 19:21:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9624da70-130e-431f-9436-49977d48994d tempest-GroupsV314Test-36653340 None] Group tempest-GroupsV314Test-Group-1847917701: creating Apr 24 19:21:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9624da70-130e-431f-9436-49977d48994d tempest-GroupsV314Test-36653340 None] Group tempest-GroupsV314Test-Group-1847917701: created successfully Apr 24 19:21:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9624da70-130e-431f-9436-49977d48994d tempest-GroupsV314Test-36653340 None] Create group completed successfully. Apr 24 19:21:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Creating offline snapshot 42d430ca-10b6-428a-a346-ab6e98ecad3c of volume 3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:21:57 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d221a0f3-21e1-41f1-9de5-54832ad2fcc5]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:57 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 Apr 24 19:21:57 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:58 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78" returned: 0 in 0.801s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:58 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c 1G Apr 24 19:21:58 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Flow 'volume_create_manager' (f7b06035-1bbe-429f-8fca-da0f97d0bcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45295687-282c-4ae2-acb5-93abe4d12399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45295687-282c-4ae2-acb5-93abe4d12399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1415213473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cae75028-9c3c-4522-8f85-0afa70350f1e,host='devstack@QuobyteHD#QuobyteHD',id=622983cb-9302-4b93-864b-2e852ce9aaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a600efb38468431e8a3542090672866f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:58Z,use_quota=True,user_id='0220eea892b24928985baee7a749bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c74ce0-c024-4928-bcdb-6558f722ed56),volume_type_id=57c74ce0-c024-4928-bcdb-6558f722ed56)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd830e56-bd1c-463d-95aa-65e380b37970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd830e56-bd1c-463d-95aa-65e380b37970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb63b1e8-7695-479c-9618-c0e25800d642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb63b1e8-7695-479c-9618-c0e25800d642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622983cb-9302-4b93-864b-2e852ce9aaac', 'volume_name': 'volume-622983cb-9302-4b93-864b-2e852ce9aaac', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fb3bcd-295b-4680-89d0-139b93fac23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fb3bcd-295b-4680-89d0-139b93fac23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa1dfbc-5402-4736-b55a-da6b293daa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:58 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Volume 622983cb-9302-4b93-864b-2e852ce9aaac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622983cb-9302-4b93-864b-2e852ce9aaac', 'volume_size': 1} Apr 24 19:21:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:59 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c 1G" returned: 0 in 0.881s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c261949-0623-4799-83f7-94435e969b78 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:59 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c261949-0623-4799-83f7-94435e969b78 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c Apr 24 19:21:59 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:59 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c261949-0623-4799-83f7-94435e969b78 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c" returned: 0 in 0.682s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:59 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c is being set with open permissions: ugo+rw Apr 24 19:21:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:59 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c Apr 24 19:21:59 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:00 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c" returned: 0 in 0.577s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:00 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.info Apr 24 19:22:00 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:01 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.info" returned: 0 in 0.632s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:01 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.info is being set with open permissions: ugo+rw Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:01 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.info Apr 24 19:22:01 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:01 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.info" returned: 0 in 0.559s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.351s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.164s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cae75028-9c3c-4522-8f85-0afa70350f1e,created_at=2026-04-24T17:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1415213473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cae75028-9c3c-4522-8f85-0afa70350f1e,host='devstack@QuobyteHD#QuobyteHD',id=622983cb-9302-4b93-864b-2e852ce9aaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a600efb38468431e8a3542090672866f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:58Z,use_quota=True,user_id='0220eea892b24928985baee7a749bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c74ce0-c024-4928-bcdb-6558f722ed56),volume_type_id=57c74ce0-c024-4928-bcdb-6558f722ed56)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Creating volume 622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:01 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:22:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:01 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac 1073741824 Apr 24 19:22:01 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:01 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c8b3660e-beac-4d32-bdff-024a283f6f2c tempest-VolumesDeleteCascade-727238206 None] Create snapshot completed successfully Apr 24 19:22:02 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac 1073741824" returned: 0 in 0.966s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:02 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac Apr 24 19:22:02 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Flow 'volume_create_manager' (6a135736-311a-4965-ae81-6e6197e7f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7382f8db-7965-44d5-99c3-dfd4df49af98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7382f8db-7965-44d5-99c3-dfd4df49af98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1316545521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb37af2-658e-4fd3-96e9-12d8a6ab617d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7954620ee0e42958f1c6ac788567b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=42d430ca-10b6-428a-a346-ab6e98ecad3c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:03Z,use_quota=True,user_id='4b301da693ef4ad0b2f0b6be0a136329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcae6fa8-2821-4bdc-9d19-54b071353c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcae6fa8-2821-4bdc-9d19-54b071353c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9e1eff-0d64-4dcf-9442-219a997862e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9e1eff-0d64-4dcf-9442-219a997862e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8bb37af2-658e-4fd3-96e9-12d8a6ab617d', 'volume_name': 'volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d', 'volume_size': 1, 'snapshot_id': '42d430ca-10b6-428a-a346-ab6e98ecad3c'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddcce0a-a818-4afb-a145-0951cf195e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddcce0a-a818-4afb-a145-0951cf195e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35727ae6-b9e1-4300-b469-1fa091270442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:03 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Volume 8bb37af2-658e-4fd3-96e9-12d8a6ab617d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d', 'volume_size': 1, 'snapshot_id': '42d430ca-10b6-428a-a346-ab6e98ecad3c'} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:03 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac" returned: 0 in 0.701s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.049s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-42d430ca-10b6-428a-a346-ab6e98ecad3c-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" by "_create_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa1dfbc-5402-4736-b55a-da6b293daa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622983cb-9302-4b93-864b-2e852ce9aaac', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028da5bf-8c83-48d6-a808-d17d9377f18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-42d430ca-10b6-428a-a346-ab6e98ecad3c-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Creating volume 8bb37af2-658e-4fd3-96e9-12d8a6ab617d from snapshot 42d430ca-10b6-428a-a346-ab6e98ecad3c {{(pid=81943) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:03 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Volume volume-622983cb-9302-4b93-864b-2e852ce9aaac (622983cb-9302-4b93-864b-2e852ce9aaac): created successfully Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028da5bf-8c83-48d6-a808-d17d9377f18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Flow 'volume_create_manager' (f7b06035-1bbe-429f-8fca-da0f97d0bcf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:03 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-dbc8017b-2001-42b5-b129-6ce16e622d84 tempest-GroupsV314Test-36653340 None] Created volume successfully. Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] snapshot: 42d430ca-10b6-428a-a346-ab6e98ecad3c, volume: 8bb37af2-658e-4fd3-96e9-12d8a6ab617d, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a59cf51-324b-4ac7-958f-6001014d5741]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:03 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c Apr 24 19:22:03 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:04 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c" returned: 0 in 1.004s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c261949-0623-4799-83f7-94435e969b78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:22:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:22:04 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d9eba-9707-4b06-855d-e6f503e3c55b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:04 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 Apr 24 19:22:04 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:05 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78" returned: 0 in 0.637s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:05 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d Apr 24 19:22:05 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Flow 'volume_create_manager' (1bf6c879-50c3-43e6-977e-11c0d35dfabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7447b48-65bd-4c91-ad20-b7eeebbd3d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7447b48-65bd-4c91-ad20-b7eeebbd3d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1899256466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5117065-cbd5-403b-baa9-a3a2c9ecc57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082a0e4a49d941279eb90b865c1af54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:06Z,use_quota=True,user_id='84cee5e8cbf248bb8be702de7a99d85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d23f157-b691-4145-a547-cab60986627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d23f157-b691-4145-a547-cab60986627e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08122132-40d9-4e34-8beb-48b83d500cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08122132-40d9-4e34-8beb-48b83d500cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5117065-cbd5-403b-baa9-a3a2c9ecc57f', 'volume_name': 'volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09809d85-f226-43af-9d9b-b18a258f4af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09809d85-f226-43af-9d9b-b18a258f4af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f293c36b-80ef-4c19-95ba-a58eb1364e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:05 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Volume f5117065-cbd5-403b-baa9-a3a2c9ecc57f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f', 'volume_size': 1} Apr 24 19:22:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:10 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" returned: 0 in 5.162s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:10 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78e77c8-0453-4069-9a5e-f8b754a47f96]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:10 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 Apr 24 19:22:10 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:11 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78" returned: 0 in 0.666s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:22:11 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Converted 1024.00 MB image at 198.35 MB/s Apr 24 19:22:11 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d is being set with open permissions: ugo+rw Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:11 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d Apr 24 19:22:11 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:11 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" returned: 0 in 0.522s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" released by "_copy_volume_from_snapshot" :: held 8.143s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-42d430ca-10b6-428a-a346-ab6e98ecad3c-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" released by "_create_volume_from_snapshot" :: held 8.220s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.269s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.277s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1e5da-12a7-49b6-a819-c15fe219e510]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35727ae6-b9e1-4300-b469-1fa091270442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d', 'volume_size': 1, 'snapshot_id': '42d430ca-10b6-428a-a346-ab6e98ecad3c'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3490197f-3b5c-445b-9cf7-30a5ce032dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:11 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Volume volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d (8bb37af2-658e-4fd3-96e9-12d8a6ab617d): created successfully Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3490197f-3b5c-445b-9cf7-30a5ce032dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Flow 'volume_create_manager' (6a135736-311a-4965-ae81-6e6197e7f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:11 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad Apr 24 19:22:11 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:11 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1a2105e9-757d-4dfc-9fdf-26e27bbac335 tempest-VolumesDeleteCascade-727238206 None] Created volume successfully. Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-3c261949-0623-4799-83f7-94435e969b78-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-3c261949-0623-4799-83f7-94435e969b78-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Performing cascade delete. {{(pid=81943) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-42d430ca-10b6-428a-a346-ab6e98ecad3c-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-42d430ca-10b6-428a-a346-ab6e98ecad3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-3c261949-0623-4799-83f7-94435e969b78" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-3c261949-0623-4799-83f7-94435e969b78" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-42d430ca-10b6-428a-a346-ab6e98ecad3c" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-42d430ca-10b6-428a-a346-ab6e98ecad3c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Deleting offline snapshot 42d430ca-10b6-428a-a346-ab6e98ecad3c of volume 3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] snapshot_file for this snap is: volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:22:12 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" returned: 0 in 0.640s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[4232cb89-b998-4d2e-a03a-2b752f12c763]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae04a1-fd95-4865-95d8-acd1a89e9f55]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:12 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad Apr 24 19:22:12 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c Apr 24 19:22:12 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:12 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:13 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" returned: 0 in 0.548s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.dd00339f-e92b-4ec8-9c10-8d6a66fda574sj1gnw7b.img {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:13 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.dd00339f-e92b-4ec8-9c10-8d6a66fda574sj1gnw7b.img Apr 24 19:22:13 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:13 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c" returned: 0 in 0.603s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c261949-0623-4799-83f7-94435e969b78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:13 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f16a47-aefc-4fd3-b0c2-42577e4701d1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:13 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 Apr 24 19:22:13 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:13 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78" returned: 0 in 0.815s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:13 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c Apr 24 19:22:13 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:15 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c" returned: 0 in 1.425s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:15 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c Apr 24 19:22:15 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:16 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78.42d430ca-10b6-428a-a346-ab6e98ecad3c" returned: 0 in 1.183s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-42d430ca-10b6-428a-a346-ab6e98ecad3c" released by "_delete_snapshot" :: held 4.161s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-3c261949-0623-4799-83f7-94435e969b78" released by "delete_snapshot" :: held 4.194s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:16 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Created reservations ['00475c50-1ea7-470c-9357-bddf803d9b84', 'e8d42eb5-2f01-44e6-a2f4-140586b22491', '1034d00b-3302-4333-a193-ea89b186dd3f', 'bf385fea-03ad-4703-8ebe-b4909a78e90b'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:16 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Delete snapshot completed successfully. Apr 24 19:22:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-42d430ca-10b6-428a-a346-ab6e98ecad3c-delete_snapshot" released by "delete_snapshot" :: held 4.490s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:16 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Snapshots deleted, issuing volume delete {{(pid=81943) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 19:22:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-3c261949-0623-4799-83f7-94435e969b78" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-3c261949-0623-4799-83f7-94435e969b78" acquired by "delete_volume" :: waited 0.029s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:17 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42cd849-e55d-47dd-884f-d08ede144c99]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:17 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 Apr 24 19:22:17 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:18 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.dd00339f-e92b-4ec8-9c10-8d6a66fda574sj1gnw7b.img" returned: 0 in 5.410s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:18 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc427f81-fdb0-45f5-9c11-fd9bd317f710]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:18 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78" returned: 0 in 1.483s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:18 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78 Apr 24 19:22:18 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:18 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad Apr 24 19:22:18 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:19 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3c261949-0623-4799-83f7-94435e969b78" returned: 0 in 0.517s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-3c261949-0623-4799-83f7-94435e969b78" released by "delete_volume" :: held 2.152s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Created reservations ['1ad93c9d-4e4d-43b6-98cf-05b1bebb6178', 'c7191446-9ea3-4c80-b739-c58fb5a426f1', 'ed89767d-3f7a-4b3e-be8e-c8ba5b2d9b02', '8c15494d-ef6d-49ed-8dc1-4525e2ed6168'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:19 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" returned: 0 in 0.748s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.dd00339f-e92b-4ec8-9c10-8d6a66fda574sj1gnw7b.img {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:22:19 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Converted 1024.00 MB image at 189.21 MB/s Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] dd00339f-e92b-4ec8-9c10-8d6a66fda574 was raw, no need to convert to raw {{(pid=81943) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:19 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:22:19 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:19 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.556s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:19 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Deleted volume successfully. Apr 24 19:22:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b4a86c04-d132-47c9-a6eb-bfc51ad23a2c tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-3c261949-0623-4799-83f7-94435e969b78-delete_volume" released by "delete_volume" :: held 7.523s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-8bb37af2-658e-4fd3-96e9-12d8a6ab617d-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-8bb37af2-658e-4fd3-96e9-12d8a6ab617d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "cinder-quobyte-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:20 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1df25fc-5cb8-4175-8ef7-9e4c02b4ab1c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:20 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d Apr 24 19:22:20 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:21 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" returned: 0 in 0.598s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:21 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d Apr 24 19:22:21 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:21 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" returned: 0 in 0.472s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-quobyte-8bb37af2-658e-4fd3-96e9-12d8a6ab617d" released by "delete_volume" :: held 1.115s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Created reservations ['0e0d70f2-a2ba-4140-9df6-5f457e188029', '1270a5b2-b04c-494e-87f4-04111d95ed26', '50074809-6027-46c6-bdf3-aa3dafc5a8d4', 'e46de582-89ad-416e-9681-6f60d08f5158'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:21 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:22:21 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:22 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.538s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:22 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:22 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Deleted volume successfully. Apr 24 19:22:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-af3e519d-f4c6-452d-a03d-639f6b4f29a6 tempest-VolumesDeleteCascade-727238206 None] Lock "cinder-8bb37af2-658e-4fd3-96e9-12d8a6ab617d-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=97,cinder:UPDATE=86,cinder:INSERT=25,cinder:DELETE=3 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Flow 'volume_create_manager' (be9d04b7-680e-4bc1-a68b-55f2c494cb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4b27c6-ea35-45f0-8fc2-7ba40304acfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4b27c6-ea35-45f0-8fc2-7ba40304acfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1818800865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55d21f7-b496-4ee9-945f-3b7542fc53cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5442b97454bf4c828425ea5247e3d429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:26Z,use_quota=True,user_id='c1cce68e4a7d4cb2be40e2b8b89d6fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e4f8f9-9013-4704-a02c-e2da1e0b2f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e4f8f9-9013-4704-a02c-e2da1e0b2f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1529cef0-55d1-4e62-89ea-cfa11ea78055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1529cef0-55d1-4e62-89ea-cfa11ea78055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55d21f7-b496-4ee9-945f-3b7542fc53cb', 'volume_name': 'volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb', 'volume_size': 2}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c72dbb7-995c-4b3d-8644-c08568ae045a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c72dbb7-995c-4b3d-8644-c08568ae045a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88b9508-09af-4141-b0e0-8374e1e2ef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:26 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Volume b55d21f7-b496-4ee9-945f-3b7542fc53cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb', 'volume_size': 2} Apr 24 19:22:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:36 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=105,cinder:SELECT=91,cinder:DELETE=9,cinder:INSERT=17 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:22:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.684s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Uploaded volume to glance image-id: dd00339f-e92b-4ec8-9c10-8d6a66fda574. {{(pid=81943) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 19:22:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 30.875s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:36 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Cloning volume 622983cb-9302-4b93-864b-2e852ce9aaac to volume d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 Apr 24 19:22:36 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-36a02071-8143-41a6-ba25-11e639ead710 tempest-VolumesActionsTest-2133753489 None] Copy volume to image completed successfully. Apr 24 19:22:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Creating offline snapshot 3ffa25d8-6a66-428f-a3b0-6d8d71222133 of volume 622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:22:36 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a9cd62-01f7-4c16-90fe-c3f183ad16e3]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:36 devstack sudo[87621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac Apr 24 19:22:36 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:37 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac" returned: 0 in 0.699s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:37 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 1G Apr 24 19:22:37 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:37 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 1G" returned: 0 in 0.734s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622983cb-9302-4b93-864b-2e852ce9aaac -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:37 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622983cb-9302-4b93-864b-2e852ce9aaac -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 Apr 24 19:22:37 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:38 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622983cb-9302-4b93-864b-2e852ce9aaac -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133" returned: 0 in 0.536s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:38 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:22:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:38 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 Apr 24 19:22:38 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:38 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133" returned: 0 in 0.485s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:39 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.info Apr 24 19:22:39 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:39 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.info" returned: 0 in 0.447s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:39 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:22:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:39 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.info Apr 24 19:22:39 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:39 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.info" returned: 0 in 0.486s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:39 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Acquiring lock "cinder-quobyte-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Lock "cinder-quobyte-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] snapshot: 3ffa25d8-6a66-428f-a3b0-6d8d71222133, volume: d5b3135a-56ab-4a98-9a4e-2895ef8c18f6, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[79973258-f27c-4101-b080-ee9a0ba11879]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:40 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 Apr 24 19:22:40 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:40 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133" returned: 0 in 0.533s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622983cb-9302-4b93-864b-2e852ce9aaac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0075194b-c7ea-49f2-9eaa-344bce5d7bf7]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:40 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac Apr 24 19:22:40 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:40 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:22:40 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:41 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac" returned: 0 in 0.601s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:41 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:22:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:41 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 Apr 24 19:22:41 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:41 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.529s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:41 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:46 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6" returned: 0 in 4.924s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:46 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec005774-6b0f-42df-ab7b-7dbaff4efff6]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:46 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac Apr 24 19:22:46 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:46 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac" returned: 0 in 0.744s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:46 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:22:46 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Converted 1024.00 MB image at 207.90 MB/s Apr 24 19:22:46 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:22:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:46 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 Apr 24 19:22:46 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:47 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6" returned: 0 in 0.500s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Lock "cinder-quobyte-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6" released by "_copy_volume_from_snapshot" :: held 7.386s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Acquiring lock "cinder-quobyte-3ffa25d8-6a66-428f-a3b0-6d8d71222133" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Lock "cinder-quobyte-3ffa25d8-6a66-428f-a3b0-6d8d71222133" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Deleting offline snapshot 3ffa25d8-6a66-428f-a3b0-6d8d71222133 of volume 622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:22:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] snapshot_file for this snap is: volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:22:47 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d4075-9bcb-4dfb-aa98-85c368ceaeea]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:47 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 Apr 24 19:22:47 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:48 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133" returned: 0 in 0.587s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622983cb-9302-4b93-864b-2e852ce9aaac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:48 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8a1e3c-5b5e-4e7d-a2a5-ed757c5ddf02]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:48 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac Apr 24 19:22:48 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:48 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac" returned: 0 in 0.686s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:48 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 Apr 24 19:22:48 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:49 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:INSERT=2,cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:22:49 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133" returned: 0 in 0.632s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:49 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133 Apr 24 19:22:49 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:49 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac.3ffa25d8-6a66-428f-a3b0-6d8d71222133" returned: 0 in 0.574s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Lock "cinder-quobyte-3ffa25d8-6a66-428f-a3b0-6d8d71222133" released by "_delete_snapshot" :: held 2.601s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.577s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 44.146s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1899256466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5117065-cbd5-403b-baa9-a3a2c9ecc57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082a0e4a49d941279eb90b865c1af54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:06Z,use_quota=True,user_id='84cee5e8cbf248bb8be702de7a99d85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Creating volume f5117065-cbd5-403b-baa9-a3a2c9ecc57f {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:50 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:50 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f 1073741824 Apr 24 19:22:50 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:50 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-433fa4e8-40d2-42f4-aa52-024d3af18de6 tempest-GroupsV314Test-36653340 None] Create group from source-group-cae75028-9c3c-4522-8f85-0afa70350f1e completed successfully. Apr 24 19:22:50 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f 1073741824" returned: 0 in 0.685s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:50 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f Apr 24 19:22:50 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Acquiring lock "cinder-quobyte-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Lock "cinder-quobyte-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:51 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f" returned: 0 in 0.522s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[42279ace-ab3f-42dd-9d73-bb24b94cf8c2]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.162s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1818800865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55d21f7-b496-4ee9-945f-3b7542fc53cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5442b97454bf4c828425ea5247e3d429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:26Z,use_quota=True,user_id='c1cce68e4a7d4cb2be40e2b8b89d6fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Creating volume b55d21f7-b496-4ee9-945f-3b7542fc53cb {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:51 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb 2147483648 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f293c36b-80ef-4c19-95ba-a58eb1364e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:51 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb 2147483648 Apr 24 19:22:51 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf22591-3d58-488d-b323-2f7e29548add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:51 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Volume volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f (f5117065-cbd5-403b-baa9-a3a2c9ecc57f): created successfully Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf22591-3d58-488d-b323-2f7e29548add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Flow 'volume_create_manager' (1bf6c879-50c3-43e6-977e-11c0d35dfabc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:51 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9c78166e-7853-4286-852d-4e59b5a4ee78 tempest-VolumesServicesTestJSON-1905005992 None] Created volume successfully. Apr 24 19:22:51 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 Apr 24 19:22:51 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:52 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6" returned: 0 in 0.722s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:52 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6 Apr 24 19:22:52 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Acquiring lock "cinder-f5117065-cbd5-403b-baa9-a3a2c9ecc57f-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Lock "cinder-f5117065-cbd5-403b-baa9-a3a2c9ecc57f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:52 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb 2147483648" returned: 0 in 0.913s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Acquiring lock "cinder-quobyte-f5117065-cbd5-403b-baa9-a3a2c9ecc57f" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Lock "cinder-quobyte-f5117065-cbd5-403b-baa9-a3a2c9ecc57f" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f0ee10-67c6-4c97-be74-a9b23af031d3]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:52 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb Apr 24 19:22:52 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:52 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f Apr 24 19:22:52 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:52 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6" returned: 0 in 0.592s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Lock "cinder-quobyte-d5b3135a-56ab-4a98-9a4e-2895ef8c18f6" released by "delete_volume" :: held 1.383s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Created reservations ['8cfc8b44-c479-4886-b66e-9e5066d9e337'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:52 devstack cinder-volume[81943]: WARNING cinder.quota [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1796672711 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1796672711, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:22:52 devstack cinder-volume[81943]: WARNING cinder.quota [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1796672711 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1796672711, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Created reservations ['21e45c07-c78f-4a8f-b1c8-ad95bae3cd90', 'a573e384-ebbe-440e-9911-e247568d74b0', '774bb38e-7d01-4b69-a9a1-c766426a5ebd', '67368517-521c-4b44-b2b8-4ef136fa38d6'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:52 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb" returned: 0 in 0.585s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 15.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88b9508-09af-4141-b0e0-8374e1e2ef42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb', 'volume_size': 2}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e801f3d-cbe4-44af-bc3a-9b94164279e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0e24a8-254a-4357-9637-c041211cbeb2]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f" returned: 0 in 0.766s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:53 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad Apr 24 19:22:53 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:53 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:53 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f Apr 24 19:22:53 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:53 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Volume volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb (b55d21f7-b496-4ee9-945f-3b7542fc53cb): created successfully Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e801f3d-cbe4-44af-bc3a-9b94164279e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Flow 'volume_create_manager' (be9d04b7-680e-4bc1-a68b-55f2c494cb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:53 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-aec983bc-7df9-4294-8fb0-696fb689ee4b tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Created volume successfully. Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:53 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:22:53 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:53 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f5117065-cbd5-403b-baa9-a3a2c9ecc57f" returned: 0 in 0.691s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Lock "cinder-quobyte-f5117065-cbd5-403b-baa9-a3a2c9ecc57f" released by "delete_volume" :: held 1.530s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:53 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Acquiring lock "cinder-quobyte-622983cb-9302-4b93-864b-2e852ce9aaac" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" returned: 0 in 0.953s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Created reservations ['e5c8d48a-9ea2-469e-b16a-4cfca7d92c76', '116260e4-f75f-4e27-a13b-132ba2434a84', 'bd89e6f0-3ce0-415e-8f4a-661ab83c8231', '10ffa2f2-5042-4586-987f-476c62300730'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed482c6-6dcd-4740-8fbc-66ecc804955e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Lock "cinder-quobyte-622983cb-9302-4b93-864b-2e852ce9aaac" acquired by "delete_volume" :: waited 0.045s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a06751e-c96b-4b07-9219-e459bfb905af]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:54 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad Apr 24 19:22:54 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:54 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:22:54 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:54 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac Apr 24 19:22:54 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:54 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.767s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:54 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-43842dbd-55a5-4247-b648-05035cd45168 tempest-GroupsV314Test-36653340 None] Delete group completed successfully. Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:54 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.572s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:54 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Deleted volume successfully. Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-426202f3-c52a-4c42-aaa9-d0fa0cc41e6a tempest-VolumesServicesTestJSON-1905005992 None] Lock "cinder-f5117065-cbd5-403b-baa9-a3a2c9ecc57f-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:54 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" returned: 0 in 0.712s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:54 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img Apr 24 19:22:54 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:54 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac" returned: 0 in 0.861s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:54 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac Apr 24 19:22:54 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:55 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-622983cb-9302-4b93-864b-2e852ce9aaac" returned: 0 in 1.015s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Lock "cinder-quobyte-622983cb-9302-4b93-864b-2e852ce9aaac" released by "delete_volume" :: held 1.980s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:56 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Created reservations ['fcae00aa-daff-4f8a-9e2f-16ded1d3fb00'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:56 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Created reservations ['a9af63ea-77ac-4ddf-8d25-34da8365b414', '0240b455-eafb-468f-a056-e88dbbb6b663', 'a4f0a8fa-9797-46ed-b091-a780c513c500', '55d33e94-832f-4532-a26d-caabafa1ddf5'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:56 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:22:56 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:58 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.351s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:58 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:58 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5d216347-e33f-499b-b55b-dc1701b62fc3 tempest-GroupsV314Test-36653340 None] Delete group completed successfully. Apr 24 19:23:01 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img" returned: 0 in 6.846s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:01 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d53f372-d260-4698-81ff-09533b75adea]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:01 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad Apr 24 19:23:01 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:02 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" returned: 0 in 0.982s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:02 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:23:02 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Converted 1024.00 MB image at 149.55 MB/s Apr 24 19:23:02 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] cc39f93d-c266-41d7-850d-a2a7450e0988 was raw, converting to qcow2 {{(pid=81943) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 24 19:23:02 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7ca880-af12-4005-ba27-f9e405623541]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:02 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img Apr 24 19:23:02 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:03 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img" returned: 0 in 0.640s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:03 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img Apr 24 19:23:03 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:03 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img" returned: 1 in 0.665s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:23:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img /opt/stack/data/cinder/conversion/vol_upload_eggcgmgg {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:03 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img /opt/stack/data/cinder/conversion/vol_upload_eggcgmgg Apr 24 19:23:03 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Flow 'volume_create_manager' (35c453d5-adae-4338-ab0c-4f7d89ce9f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd79bf63-d340-435b-ba25-27b73fd9df78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd79bf63-d340-435b-ba25-27b73fd9df78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-32958932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9c87d6-6d33-4631-af3d-092e429a1f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acb367392bb47c2982b9c994e7a68dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:04Z,use_quota=True,user_id='d87d5cd041484ce68530150da8e187ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(202d1e20-029e-4bb7-8b8b-8c7d467b3452),volume_type_id=202d1e20-029e-4bb7-8b8b-8c7d467b3452)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3b9038-35b3-4b13-ba96-7207d9df0769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3b9038-35b3-4b13-ba96-7207d9df0769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355198a9-f104-4c54-a17a-3c35e3612255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355198a9-f104-4c54-a17a-3c35e3612255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9c87d6-6d33-4631-af3d-092e429a1f3f', 'volume_name': 'volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9103bc7-0568-438a-ad54-f33bbbdb9d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9103bc7-0568-438a-ad54-f33bbbdb9d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f233df4-2d8c-45f6-8ba5-82eaf947246f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:04 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Volume bf9c87d6-6d33-4631-af3d-092e429a1f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f', 'volume_size': 1} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:04 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img /opt/stack/data/cinder/conversion/vol_upload_eggcgmgg" returned: 0 in 0.792s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Image conversion details: src /opt/stack/data/cinder/conversion/b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad.temp_image.cc39f93d-c266-41d7-850d-a2a7450e0988auqpinp6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_eggcgmgg {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:23:04 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f228df55-2cc5-440d-8866-25efdc1e72c9]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eggcgmgg {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:04 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eggcgmgg Apr 24 19:23:04 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:05 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eggcgmgg" returned: 0 in 0.653s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.318s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:07 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Uploaded volume to glance image-id: cc39f93d-c266-41d7-850d-a2a7450e0988. {{(pid=81943) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 19:23:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.660s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Creating offline snapshot 98df2d8f-d8a6-4533-a71a-6248ef84a36b of volume b55d21f7-b496-4ee9-945f-3b7542fc53cb {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:23:07 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e8932e01-43a8-47bd-ad6d-8e58c17a7130 tempest-VolumesActionsTest-2133753489 None] Copy volume to image completed successfully. Apr 24 19:23:07 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d9f4ce-caf5-4c7d-92fa-8103edc1e796]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:07 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb Apr 24 19:23:07 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:08 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb" returned: 0 in 0.742s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b 2G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:08 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b 2G Apr 24 19:23:08 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:08 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b 2G" returned: 0 in 0.951s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:09 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b Apr 24 19:23:09 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:09 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Acquiring lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:09 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:09 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Acquiring lock "cinder-quobyte-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:09 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Lock "cinder-quobyte-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:09 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[78464d5c-a255-4b34-8465-90f8a819a81d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:09 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad Apr 24 19:23:09 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:09 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b" returned: 0 in 0.690s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:09 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b is being set with open permissions: ugo+rw Apr 24 19:23:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:09 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b Apr 24 19:23:09 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:09 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" returned: 0 in 0.730s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:09 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad Apr 24 19:23:09 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:10 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b" returned: 0 in 0.593s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:10 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.info Apr 24 19:23:10 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:10 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" returned: 0 in 0.640s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Lock "cinder-quobyte-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad" released by "delete_volume" :: held 1.433s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Created reservations ['77e9a9a0-ee6b-47c5-a33d-dd01d137377d', '4c6bac9b-87f8-4b6d-bba1-3d4ee533fbbc', 'fefa0b33-0a4c-4a40-8f93-997ce98ab4bb', '010f16c6-d72e-41cb-8300-81f8728c676b'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:10 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:10 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:10 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.info" returned: 0 in 0.681s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:10 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.info is being set with open permissions: ugo+rw Apr 24 19:23:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:11 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.info Apr 24 19:23:11 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:11 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.712s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:11 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Deleted volume successfully. Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c22678dd-5018-423e-82cd-2466e354de08 tempest-VolumesActionsTest-2133753489 None] Lock "cinder-b9d1c23f-6cf7-43ff-bd0b-33d2fca0aaad-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:11 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.info" returned: 0 in 0.622s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.408s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.068s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-32958932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9c87d6-6d33-4631-af3d-092e429a1f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acb367392bb47c2982b9c994e7a68dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:04Z,use_quota=True,user_id='d87d5cd041484ce68530150da8e187ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(202d1e20-029e-4bb7-8b8b-8c7d467b3452),volume_type_id=202d1e20-029e-4bb7-8b8b-8c7d467b3452)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Creating volume bf9c87d6-6d33-4631-af3d-092e429a1f3f {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:11 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:23:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:11 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f 1073741824 Apr 24 19:23:11 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:11 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-fd75e206-dae3-48cc-b4bd-925f3a449c80 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Create snapshot completed successfully Apr 24 19:23:12 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f 1073741824" returned: 0 in 1.013s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Acquiring lock "cinder-98df2d8f-d8a6-4533-a71a-6248ef84a36b-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "cinder-98df2d8f-d8a6-4533-a71a-6248ef84a36b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:12 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Acquiring lock "cinder-quobyte-b55d21f7-b496-4ee9-945f-3b7542fc53cb" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:12 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "cinder-quobyte-b55d21f7-b496-4ee9-945f-3b7542fc53cb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Acquiring lock "cinder-quobyte-98df2d8f-d8a6-4533-a71a-6248ef84a36b" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "cinder-quobyte-98df2d8f-d8a6-4533-a71a-6248ef84a36b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Deleting offline snapshot 98df2d8f-d8a6-4533-a71a-6248ef84a36b of volume b55d21f7-b496-4ee9-945f-3b7542fc53cb {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] snapshot_file for this snap is: volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0506d67-b47e-47c6-a7b1-9fc33122dfb5]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:13 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b Apr 24 19:23:13 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:13 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f" returned: 0 in 0.899s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f233df4-2d8c-45f6-8ba5-82eaf947246f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9bb6db-3821-4eeb-a37d-c302e004b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:13 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Volume volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f (bf9c87d6-6d33-4631-af3d-092e429a1f3f): created successfully Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9bb6db-3821-4eeb-a37d-c302e004b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Flow 'volume_create_manager' (35c453d5-adae-4338-ab0c-4f7d89ce9f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:13 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:13 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3f5cfe0f-bb60-4f0e-9b5d-bd7bcd22f7a5 tempest-VolumeTypesAccessTest-871651720 None] Created volume successfully. Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b" returned: 0 in 0.819s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e28efa-ce68-44d3-8a1f-07f0e4ffde51]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:13 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb Apr 24 19:23:13 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Acquiring lock "cinder-bf9c87d6-6d33-4631-af3d-092e429a1f3f-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Lock "cinder-bf9c87d6-6d33-4631-af3d-092e429a1f3f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Acquiring lock "cinder-quobyte-bf9c87d6-6d33-4631-af3d-092e429a1f3f" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:14 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Lock "cinder-quobyte-bf9c87d6-6d33-4631-af3d-092e429a1f3f" acquired by "delete_volume" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:14 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c632830-911b-40d1-8e39-d18a36845213]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:14 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb" returned: 0 in 0.857s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:14 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b Apr 24 19:23:14 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:14 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f Apr 24 19:23:14 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:15 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f" returned: 0 in 0.760s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:15 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f Apr 24 19:23:15 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:15 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b" returned: 0 in 1.081s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:15 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b Apr 24 19:23:15 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:16 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bf9c87d6-6d33-4631-af3d-092e429a1f3f" returned: 0 in 0.815s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Lock "cinder-quobyte-bf9c87d6-6d33-4631-af3d-092e429a1f3f" released by "delete_volume" :: held 1.632s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:16 devstack cinder-volume[81943]: WARNING cinder.quota [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-497564089 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-497564089, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:23:16 devstack cinder-volume[81943]: WARNING cinder.quota [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-497564089 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-497564089, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Created reservations ['2a06f92f-f051-47c2-b460-436125812f25', '77c9f5e2-5d0f-4420-9f8f-8d7d967b818e', '52f705b3-182f-4479-8adf-3e6748b141bb', '40b36ea9-489b-4b0b-a0b8-f3016115ed15'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:16 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:16 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:16 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb.98df2d8f-d8a6-4533-a71a-6248ef84a36b" returned: 0 in 0.822s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "cinder-quobyte-98df2d8f-d8a6-4533-a71a-6248ef84a36b" released by "_delete_snapshot" :: held 3.738s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "cinder-quobyte-b55d21f7-b496-4ee9-945f-3b7542fc53cb" released by "delete_snapshot" :: held 3.772s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:16 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Created reservations ['cd2743ae-7b9f-4c15-b2bf-72ee3e18da54', '263ffcbe-5310-4117-af4f-5ec1ac833521', '11ecab86-e101-4066-acd0-73412f584cb8', '3cba31b2-74a4-4b2c-868e-eb063b94ce8b'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:17 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Delete snapshot completed successfully. Apr 24 19:23:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8490d096-b044-44a8-bb15-7d1d14ab221c tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "cinder-98df2d8f-d8a6-4533-a71a-6248ef84a36b-delete_snapshot" released by "delete_snapshot" :: held 4.339s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Acquiring lock "cinder-b55d21f7-b496-4ee9-945f-3b7542fc53cb-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:17 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "cinder-b55d21f7-b496-4ee9-945f-3b7542fc53cb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.944s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:17 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:17 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Deleted volume successfully. Apr 24 19:23:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1a053c88-8c43-417d-ab69-e9e2ed29333a tempest-VolumeTypesAccessTest-871651720 None] Lock "cinder-bf9c87d6-6d33-4631-af3d-092e429a1f3f-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Acquiring lock "cinder-quobyte-b55d21f7-b496-4ee9-945f-3b7542fc53cb" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "cinder-quobyte-b55d21f7-b496-4ee9-945f-3b7542fc53cb" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:17 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe12a7-0719-4d2e-8c2a-e0dda363f37d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:17 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb Apr 24 19:23:17 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:18 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb" returned: 0 in 0.859s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:18 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb Apr 24 19:23:18 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:18 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b55d21f7-b496-4ee9-945f-3b7542fc53cb" returned: 0 in 0.578s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "cinder-quobyte-b55d21f7-b496-4ee9-945f-3b7542fc53cb" released by "delete_volume" :: held 1.516s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:19 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Created reservations ['31fc97ac-129e-435d-8ac0-94e54ba4497f', '49d26e1a-1afe-4111-8c51-d4bfcf35f916', 'f7a9e925-ecb1-4e95-a237-8ba39a1cc069', '50c4a979-ab42-4203-a14b-60328a26e997'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:19 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:19 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:19 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.602s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:19 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:19 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Deleted volume successfully. Apr 24 19:23:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e60b04d4-4bfd-4867-8b42-15f2dc9a21e7 tempest-VolumesSnapshotNegativeTestJSON-1802389428 None] Lock "cinder-b55d21f7-b496-4ee9-945f-3b7542fc53cb-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Flow 'volume_create_manager' (68a6ad38-324a-4c55-b64f-ec8e4ebf24fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8873df18-40fc-4add-a888-bf1e5d818600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8873df18-40fc-4add-a888-bf1e5d818600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-990955740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95bc4cc6-fd68-4ad7-8529-524917ef741b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98fe943bbd174ca7aafe209741d8344f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:21Z,use_quota=True,user_id='c885b289c9da4a93b82ba58b3f915702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804fa89d-3e12-443b-810e-d7cbde0d00f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804fa89d-3e12-443b-810e-d7cbde0d00f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd676e5-48f5-41aa-8398-30cc17cecb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd676e5-48f5-41aa-8398-30cc17cecb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95bc4cc6-fd68-4ad7-8529-524917ef741b', 'volume_name': 'volume-95bc4cc6-fd68-4ad7-8529-524917ef741b', 'volume_size': 2}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0d2af8-dbb7-4b8d-b8f5-e52fe4f1cc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0d2af8-dbb7-4b8d-b8f5-e52fe4f1cc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c431f59d-3373-4cff-9492-e391ca7b7d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:20 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Volume 95bc4cc6-fd68-4ad7-8529-524917ef741b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95bc4cc6-fd68-4ad7-8529-524917ef741b', 'volume_size': 2} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-990955740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95bc4cc6-fd68-4ad7-8529-524917ef741b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98fe943bbd174ca7aafe209741d8344f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:21Z,use_quota=True,user_id='c885b289c9da4a93b82ba58b3f915702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Creating volume 95bc4cc6-fd68-4ad7-8529-524917ef741b {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:20 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:23:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b 2147483648 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:20 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b 2147483648 Apr 24 19:23:20 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:21 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b 2147483648" returned: 0 in 1.037s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:21 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b Apr 24 19:23:21 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:22 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b" returned: 0 in 0.652s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c431f59d-3373-4cff-9492-e391ca7b7d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95bc4cc6-fd68-4ad7-8529-524917ef741b', 'volume_size': 2}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cd7d8f-ea34-432a-a331-2bca9f5bae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:22 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Volume volume-95bc4cc6-fd68-4ad7-8529-524917ef741b (95bc4cc6-fd68-4ad7-8529-524917ef741b): created successfully Apr 24 19:23:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cd7d8f-ea34-432a-a331-2bca9f5bae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Flow 'volume_create_manager' (68a6ad38-324a-4c55-b64f-ec8e4ebf24fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:22 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-07595db6-3763-472c-9661-7dda4f42e9cb tempest-VolumesCloneNegativeTest-1405403995 None] Created volume successfully. Apr 24 19:23:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Acquiring lock "cinder-95bc4cc6-fd68-4ad7-8529-524917ef741b-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Lock "cinder-95bc4cc6-fd68-4ad7-8529-524917ef741b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Acquiring lock "cinder-quobyte-95bc4cc6-fd68-4ad7-8529-524917ef741b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Lock "cinder-quobyte-95bc4cc6-fd68-4ad7-8529-524917ef741b" acquired by "delete_volume" :: waited 0.025s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:23 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[4796cd8e-eee0-4bf0-81fc-36c619b2397c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:23 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b Apr 24 19:23:23 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:24 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b" returned: 0 in 0.876s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:24 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b Apr 24 19:23:24 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Flow 'volume_create_manager' (4bd9b5f1-eb7e-43d8-a8a4-592ee31d1456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1d262c-075a-4110-9403-d52b2cf8f332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1d262c-075a-4110-9403-d52b2cf8f332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9760fe36-8e5d-41db-9201-3dc8ac5de306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ce6db6ec17460a91bdaea6afbb5f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:24Z,use_quota=True,user_id='6f975b57a40442b99d86ad0d9d6e7938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb72fe81-c173-46ae-bd43-d1dfcc34480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb72fe81-c173-46ae-bd43-d1dfcc34480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672ba770-455b-4c06-9b41-1e569964b334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672ba770-455b-4c06-9b41-1e569964b334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9760fe36-8e5d-41db-9201-3dc8ac5de306', 'volume_name': 'volume-9760fe36-8e5d-41db-9201-3dc8ac5de306', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22a31f3-d9f2-41cd-aa7b-739f60faa457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22a31f3-d9f2-41cd-aa7b-739f60faa457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f7f564-cdb9-4c75-aa77-2a57a2a69e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:24 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Volume 9760fe36-8e5d-41db-9201-3dc8ac5de306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9760fe36-8e5d-41db-9201-3dc8ac5de306', 'volume_size': 1} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9760fe36-8e5d-41db-9201-3dc8ac5de306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ce6db6ec17460a91bdaea6afbb5f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:24Z,use_quota=True,user_id='6f975b57a40442b99d86ad0d9d6e7938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Creating volume 9760fe36-8e5d-41db-9201-3dc8ac5de306 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:24 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:24 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306 1073741824 Apr 24 19:23:24 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:24 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-95bc4cc6-fd68-4ad7-8529-524917ef741b" returned: 0 in 0.597s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Lock "cinder-quobyte-95bc4cc6-fd68-4ad7-8529-524917ef741b" released by "delete_volume" :: held 1.539s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Created reservations ['7ec51a16-d7cd-4cf7-af52-d1b533162291', '5142953b-748d-4ab8-85bc-e97ee829822e', '396de15f-1937-430f-885d-1ed5652ad847', 'a1a405cc-8be4-48b7-a653-68a30f7ee097'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:25 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:25 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:25 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306 1073741824" returned: 0 in 0.901s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:25 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306 Apr 24 19:23:25 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:25 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.756s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:25 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:25 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Deleted volume successfully. Apr 24 19:23:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4149b2b5-a9c3-42d8-91b7-21b033e9fc25 tempest-VolumesCloneNegativeTest-1405403995 None] Lock "cinder-95bc4cc6-fd68-4ad7-8529-524917ef741b-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:26 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306" returned: 0 in 0.742s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f7f564-cdb9-4c75-aa77-2a57a2a69e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9760fe36-8e5d-41db-9201-3dc8ac5de306', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7cd31e-6ac1-4075-8e9c-630631771d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:26 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Volume volume-9760fe36-8e5d-41db-9201-3dc8ac5de306 (9760fe36-8e5d-41db-9201-3dc8ac5de306): created successfully Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7cd31e-6ac1-4075-8e9c-630631771d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Flow 'volume_create_manager' (4bd9b5f1-eb7e-43d8-a8a4-592ee31d1456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:26 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-0a12a447-aa97-4b72-8ce3-a766d5b87ac5 tempest-CinderUnicodeTest-1746804574 None] Created volume successfully. Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Flow 'volume_create_manager' (3d3c9b62-d17c-4787-961d-6689122c7a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6e3bd8-64b7-436f-8042-fb91e8355858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6e3bd8-64b7-436f-8042-fb91e8355858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-312587395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e194cd8-3a3c-4143-a586-b72515ba1b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561e43de80854f6193170c8c5d2c9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:26Z,use_quota=True,user_id='e2a07516d38941b0aa64041a5bc66630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f593749-f8b0-4381-a597-52df99bdf15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f593749-f8b0-4381-a597-52df99bdf15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b732a85-39a1-46bd-bb53-a7262e14bb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b732a85-39a1-46bd-bb53-a7262e14bb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e194cd8-3a3c-4143-a586-b72515ba1b3a', 'volume_name': 'volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bc4ac1-016d-4c41-b24e-6db2d4c8cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bc4ac1-016d-4c41-b24e-6db2d4c8cd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f17ad2-98c0-4ffe-9f18-d943a73c3261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:26 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Volume 0e194cd8-3a3c-4143-a586-b72515ba1b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a', 'volume_size': 1} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-312587395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e194cd8-3a3c-4143-a586-b72515ba1b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561e43de80854f6193170c8c5d2c9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:26Z,use_quota=True,user_id='e2a07516d38941b0aa64041a5bc66630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Creating volume 0e194cd8-3a3c-4143-a586-b72515ba1b3a {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:26 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:23:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:26 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a 1073741824 Apr 24 19:23:26 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Flow 'volume_create_manager' (44fe2827-36f9-4a9e-a6fb-22e425c5207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e677e85e-45b8-4667-a477-4a0008aefe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e677e85e-45b8-4667-a477-4a0008aefe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1814631253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4feb9caf-f887-4275-8544-498343e488a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ce6db6ec17460a91bdaea6afbb5f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:27Z,use_quota=True,user_id='6f975b57a40442b99d86ad0d9d6e7938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394b504a-a71c-4880-8324-cbde22d7a0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394b504a-a71c-4880-8324-cbde22d7a0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7da22e-0d45-43b0-9194-078ed1fcd428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7da22e-0d45-43b0-9194-078ed1fcd428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4feb9caf-f887-4275-8544-498343e488a2', 'volume_name': 'volume-4feb9caf-f887-4275-8544-498343e488a2', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359a35eb-6851-4ea5-8e82-de476f0538f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359a35eb-6851-4ea5-8e82-de476f0538f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63860c88-dda3-4e6a-b1cf-8554a69aa972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Volume 4feb9caf-f887-4275-8544-498343e488a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4feb9caf-f887-4275-8544-498343e488a2', 'volume_size': 1} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:27 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a 1073741824" returned: 0 in 1.010s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:27 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a Apr 24 19:23:27 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:28 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a" returned: 0 in 0.694s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.268s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1814631253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4feb9caf-f887-4275-8544-498343e488a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ce6db6ec17460a91bdaea6afbb5f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:27Z,use_quota=True,user_id='6f975b57a40442b99d86ad0d9d6e7938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Creating volume 4feb9caf-f887-4275-8544-498343e488a2 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:28 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f17ad2-98c0-4ffe-9f18-d943a73c3261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa9e54f-0a12-4836-b9a2-262aafd58a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:28 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 1073741824 Apr 24 19:23:28 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Volume volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a (0e194cd8-3a3c-4143-a586-b72515ba1b3a): created successfully Apr 24 19:23:28 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa9e54f-0a12-4836-b9a2-262aafd58a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Flow 'volume_create_manager' (3d3c9b62-d17c-4787-961d-6689122c7a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5a937548-e3e2-44ee-8b86-289e33a2f135 tempest-AbsoluteLimitsTests-2026372596 None] Created volume successfully. Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Acquiring lock "cinder-0e194cd8-3a3c-4143-a586-b72515ba1b3a-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Lock "cinder-0e194cd8-3a3c-4143-a586-b72515ba1b3a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Acquiring lock "cinder-quobyte-0e194cd8-3a3c-4143-a586-b72515ba1b3a" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Lock "cinder-quobyte-0e194cd8-3a3c-4143-a586-b72515ba1b3a" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4179c7c-c119-4dda-b949-fb9e77f549b0]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:29 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a Apr 24 19:23:29 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:29 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 1073741824" returned: 0 in 1.024s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:29 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 Apr 24 19:23:29 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:29 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a" returned: 0 in 0.864s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:29 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a Apr 24 19:23:29 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:30 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2" returned: 0 in 0.683s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63860c88-dda3-4e6a-b1cf-8554a69aa972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4feb9caf-f887-4275-8544-498343e488a2', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13adc809-add3-4309-a0ce-c36ab52832a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:30 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Volume volume-4feb9caf-f887-4275-8544-498343e488a2 (4feb9caf-f887-4275-8544-498343e488a2): created successfully Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13adc809-add3-4309-a0ce-c36ab52832a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Flow 'volume_create_manager' (44fe2827-36f9-4a9e-a6fb-22e425c5207c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:30 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-795ba61e-e611-40ca-beae-65a7e9d7bd4d tempest-CinderUnicodeTest-1746804574 None] Created volume successfully. Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Flow 'volume_create_manager' (20f8755d-0c88-40dd-a0d5-a71236ffc0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57acbbf9-1e21-437d-af17-4f978411f4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57acbbf9-1e21-437d-af17-4f978411f4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2060349754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28985c9-5704-440a-893d-06686a49f16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbad13e6712e479c875b71ddcfbedc6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:30Z,use_quota=True,user_id='392bf1b841d743d2ba47623b6fe0503c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae40443-d9be-4a67-837b-0a203c44179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae40443-d9be-4a67-837b-0a203c44179b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb9347c-7c52-4c79-b175-449174e995ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb9347c-7c52-4c79-b175-449174e995ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28985c9-5704-440a-893d-06686a49f16d', 'volume_name': 'volume-d28985c9-5704-440a-893d-06686a49f16d', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d13ba80-ac39-48ec-8a63-523523565ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d13ba80-ac39-48ec-8a63-523523565ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf27b35-e263-482f-a914-12b7bfde7798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:30 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Volume d28985c9-5704-440a-893d-06686a49f16d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28985c9-5704-440a-893d-06686a49f16d', 'volume_size': 1} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2060349754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28985c9-5704-440a-893d-06686a49f16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbad13e6712e479c875b71ddcfbedc6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:30Z,use_quota=True,user_id='392bf1b841d743d2ba47623b6fe0503c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Creating volume d28985c9-5704-440a-893d-06686a49f16d {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:30 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:30 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d 1073741824 Apr 24 19:23:30 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:30 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0e194cd8-3a3c-4143-a586-b72515ba1b3a" returned: 0 in 0.810s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Lock "cinder-quobyte-0e194cd8-3a3c-4143-a586-b72515ba1b3a" released by "delete_volume" :: held 1.723s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Created reservations ['785ce180-b8e0-460a-b715-83d1b0047ff6', '8370604b-d71c-49b9-aad6-a0f4e67f64fa', 'fa4a2310-916a-466d-934e-922a74c0b935', 'f5854670-b88b-4eac-a95c-45b8ed68344c'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:30 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:30 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:31 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d 1073741824" returned: 0 in 0.944s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:31 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.829s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:31 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:31 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Deleted volume successfully. Apr 24 19:23:31 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d Apr 24 19:23:31 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-0b9afea3-3cc5-4232-976c-08a621b62336 tempest-AbsoluteLimitsTests-2026372596 None] Lock "cinder-0e194cd8-3a3c-4143-a586-b72515ba1b3a-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:32 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d" returned: 0 in 0.612s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.288s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf27b35-e263-482f-a914-12b7bfde7798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28985c9-5704-440a-893d-06686a49f16d', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4c1a21-b6e2-4c28-8f01-05ded4fdd8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Creating offline snapshot 43c852f0-b523-453f-9c7e-02d8679c4335 of volume 4feb9caf-f887-4275-8544-498343e488a2 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:23:32 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Volume volume-d28985c9-5704-440a-893d-06686a49f16d (d28985c9-5704-440a-893d-06686a49f16d): created successfully Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4c1a21-b6e2-4c28-8f01-05ded4fdd8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Flow 'volume_create_manager' (20f8755d-0c88-40dd-a0d5-a71236ffc0fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8b38d0-c8a7-4045-851a-b4a96dc19631]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:32 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-a2ec5537-26f8-46bb-bbbc-12ca068dc206 tempest-SnapshotMetadataTestJSON-1876782545 None] Created volume successfully. Apr 24 19:23:32 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 Apr 24 19:23:32 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Flow 'volume_create_manager' (390f1011-1891-41e0-bbad-0ae21bd07b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7f08ba-4fd7-438f-8cce-6d8bd1d43744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7f08ba-4fd7-438f-8cce-6d8bd1d43744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1070155588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78744421-de9e-4fb6-bc54-8a5238d3e945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d291c55f88c484988d5a2f96b1be859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:33Z,use_quota=True,user_id='b90e22bbe3784c5da5967ccaf626cd8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849afe17-bc70-47ea-8f44-07c755b0a37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849afe17-bc70-47ea-8f44-07c755b0a37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58824fa0-988c-40ec-bbe4-5e265b0839dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58824fa0-988c-40ec-bbe4-5e265b0839dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78744421-de9e-4fb6-bc54-8a5238d3e945', 'volume_name': 'volume-78744421-de9e-4fb6-bc54-8a5238d3e945', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d231a6-ad56-4329-95ee-24da9064e4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d231a6-ad56-4329-95ee-24da9064e4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183a2f3b-3e70-462f-8fd6-d28b1251d0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:33 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Volume 78744421-de9e-4fb6-bc54-8a5238d3e945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78744421-de9e-4fb6-bc54-8a5238d3e945', 'volume_size': 1} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:33 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2" returned: 0 in 0.900s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:33 devstack sudo[87998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 1G Apr 24 19:23:33 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:34 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 1G" returned: 0 in 0.759s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4feb9caf-f887-4275-8544-498343e488a2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:34 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4feb9caf-f887-4275-8544-498343e488a2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 Apr 24 19:23:34 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:34 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4feb9caf-f887-4275-8544-498343e488a2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335" returned: 0 in 0.640s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:34 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 is being set with open permissions: ugo+rw Apr 24 19:23:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:34 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 Apr 24 19:23:34 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:35 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335" returned: 0 in 0.568s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:35 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.info Apr 24 19:23:35 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:35 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.info" returned: 0 in 0.507s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:35 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.info is being set with open permissions: ugo+rw Apr 24 19:23:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:35 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.info Apr 24 19:23:35 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:36 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.info" returned: 0 in 0.535s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.048s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.169s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1070155588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78744421-de9e-4fb6-bc54-8a5238d3e945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d291c55f88c484988d5a2f96b1be859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:33Z,use_quota=True,user_id='b90e22bbe3784c5da5967ccaf626cd8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Creating volume 78744421-de9e-4fb6-bc54-8a5238d3e945 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:36 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:36 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945 1073741824 Apr 24 19:23:36 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:36 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=79,cinder:UPDATE=115,cinder:INSERT=26,cinder:DELETE=10 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:23:36 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f282f208-7630-423f-9620-bfec83f14751 tempest-CinderUnicodeTest-1746804574 None] Create snapshot completed successfully Apr 24 19:23:37 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945 1073741824" returned: 0 in 0.713s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:37 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945 Apr 24 19:23:37 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "cinder-43c852f0-b523-453f-9c7e-02d8679c4335-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-43c852f0-b523-453f-9c7e-02d8679c4335-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "cinder-quobyte-4feb9caf-f887-4275-8544-498343e488a2" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-quobyte-4feb9caf-f887-4275-8544-498343e488a2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "cinder-quobyte-43c852f0-b523-453f-9c7e-02d8679c4335" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-quobyte-43c852f0-b523-453f-9c7e-02d8679c4335" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Deleting offline snapshot 43c852f0-b523-453f-9c7e-02d8679c4335 of volume 4feb9caf-f887-4275-8544-498343e488a2 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] snapshot_file for this snap is: volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cc1c2c-d973-4c37-a456-51e333844d5e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:37 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 Apr 24 19:23:37 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:37 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945" returned: 0 in 0.620s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.524s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Creating offline snapshot 5345d2d3-4e03-4301-ba74-2d2cdac4267a of volume d28985c9-5704-440a-893d-06686a49f16d {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183a2f3b-3e70-462f-8fd6-d28b1251d0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78744421-de9e-4fb6-bc54-8a5238d3e945', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251eacec-7bbd-4b90-a77f-5074f2de2b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7304385-f359-45a0-ac30-b83d0561fbe6]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:37 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Volume volume-78744421-de9e-4fb6-bc54-8a5238d3e945 (78744421-de9e-4fb6-bc54-8a5238d3e945): created successfully Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251eacec-7bbd-4b90-a77f-5074f2de2b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Flow 'volume_create_manager' (390f1011-1891-41e0-bbad-0ae21bd07b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:37 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1e6b7b87-c498-4d96-868d-0cd1d380f24f tempest-VolumesNegativeTest-881798277 None] Created volume successfully. Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Flow 'volume_create_manager' (350e0356-3fe6-4502-89fb-5af2d37c14de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b1836f-b07d-4bb4-bb9e-4b59e15df130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b1836f-b07d-4bb4-bb9e-4b59e15df130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2033687937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb66f07-f440-4bc9-92e1-7cca5c15e9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5aeac4e93344c2b2562b18ad1f48b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:38Z,use_quota=True,user_id='b4aa23675f6c490d8ffd0ea89b1a741d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3d6a85-b120-4a5f-acdc-681d57557b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3d6a85-b120-4a5f-acdc-681d57557b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:37 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d Apr 24 19:23:37 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624caabe-3850-4cbd-a2c3-ea592cd18798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624caabe-3850-4cbd-a2c3-ea592cd18798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb66f07-f440-4bc9-92e1-7cca5c15e9bf', 'volume_name': 'volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a6916c-857a-4173-a9e8-87c7300d62fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a6916c-857a-4173-a9e8-87c7300d62fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74913aa3-bb93-4d40-903d-215f51619f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:37 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Volume dcb66f07-f440-4bc9-92e1-7cca5c15e9bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf', 'volume_size': 1} Apr 24 19:23:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:38 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335" returned: 0 in 0.637s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4feb9caf-f887-4275-8544-498343e488a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:38 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[671387ee-4d60-4846-b16c-ff4d71611465]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:38 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 Apr 24 19:23:38 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:38 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d" returned: 0 in 0.682s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:38 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a 1G Apr 24 19:23:38 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:38 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2" returned: 0 in 0.725s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:38 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 Apr 24 19:23:38 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:39 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a 1G" returned: 0 in 0.780s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28985c9-5704-440a-893d-06686a49f16d -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:39 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28985c9-5704-440a-893d-06686a49f16d -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a Apr 24 19:23:39 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:39 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335" returned: 0 in 0.744s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:39 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335 Apr 24 19:23:39 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:39 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28985c9-5704-440a-893d-06686a49f16d -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a" returned: 0 in 0.695s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:39 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a is being set with open permissions: ugo+rw Apr 24 19:23:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:39 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a Apr 24 19:23:39 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:40 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2.43c852f0-b523-453f-9c7e-02d8679c4335" returned: 0 in 0.543s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-quobyte-43c852f0-b523-453f-9c7e-02d8679c4335" released by "_delete_snapshot" :: held 2.781s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-quobyte-4feb9caf-f887-4275-8544-498343e488a2" released by "delete_snapshot" :: held 2.814s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Created reservations ['c682807f-e576-4a47-a4fd-ad5856745bf7', '52829c0f-ee62-4bb7-8731-5ad7d64251af', '3a47f0b0-b298-4dfa-8b77-8189138ff83a', 'd31a1a79-6462-44a9-b9da-a44e9d33d588'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:40 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Delete snapshot completed successfully. Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9cf630da-b3d3-4475-b81f-07fe218e8466 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-43c852f0-b523-453f-9c7e-02d8679c4335-delete_snapshot" released by "delete_snapshot" :: held 3.023s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:40 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a" returned: 0 in 0.537s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:40 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.info Apr 24 19:23:40 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "cinder-4feb9caf-f887-4275-8544-498343e488a2-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-4feb9caf-f887-4275-8544-498343e488a2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "cinder-quobyte-4feb9caf-f887-4275-8544-498343e488a2" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-quobyte-4feb9caf-f887-4275-8544-498343e488a2" acquired by "delete_volume" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16dd7d4-d122-42be-a750-e07a2c7aad6b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:40 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 Apr 24 19:23:40 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:40 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:40 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:41 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.info" returned: 0 in 0.613s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:41 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.info is being set with open permissions: ugo+rw Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:41 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.info Apr 24 19:23:41 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:41 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2" returned: 0 in 0.670s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:41 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2 Apr 24 19:23:41 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:41 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.607s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:41 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.info" returned: 0 in 0.531s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.966s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.782s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2033687937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb66f07-f440-4bc9-92e1-7cca5c15e9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5aeac4e93344c2b2562b18ad1f48b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:38Z,use_quota=True,user_id='b4aa23675f6c490d8ffd0ea89b1a741d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Creating volume dcb66f07-f440-4bc9-92e1-7cca5c15e9bf {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:41 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:41 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf 1073741824 Apr 24 19:23:41 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:41 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-afb0806a-218d-42e1-8172-173992bd10de tempest-SnapshotMetadataTestJSON-1876782545 None] Create snapshot completed successfully Apr 24 19:23:41 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4feb9caf-f887-4275-8544-498343e488a2" returned: 0 in 0.571s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-quobyte-4feb9caf-f887-4275-8544-498343e488a2" released by "delete_volume" :: held 1.304s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Created reservations ['4a7a09f9-9a6c-462c-87ad-0d293a104d32', '3c98a5bd-ad6f-461a-bf2d-6eaaeaccaf8e', '69ff344a-5e44-4a45-83c6-67572c1f74b4', '3e35b964-b183-4219-bd81-90df06b33b13'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:42 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:42 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:42 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf 1073741824" returned: 0 in 0.799s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:42 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf Apr 24 19:23:42 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:42 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.686s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:42 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Deleted volume successfully. Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4ba79f03-9d62-4a25-9a20-451502b214e4 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-4feb9caf-f887-4275-8544-498343e488a2-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "cinder-9760fe36-8e5d-41db-9201-3dc8ac5de306-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-9760fe36-8e5d-41db-9201-3dc8ac5de306-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "cinder-quobyte-9760fe36-8e5d-41db-9201-3dc8ac5de306" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-quobyte-9760fe36-8e5d-41db-9201-3dc8ac5de306" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b007723a-6943-4955-84c4-47a745486753]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:43 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306 Apr 24 19:23:43 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:43 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf" returned: 0 in 0.630s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74913aa3-bb93-4d40-903d-215f51619f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ef89b7-7b30-434d-837b-b3ca2d53d3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:43 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Volume volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf (dcb66f07-f440-4bc9-92e1-7cca5c15e9bf): created successfully Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ef89b7-7b30-434d-837b-b3ca2d53d3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Flow 'volume_create_manager' (350e0356-3fe6-4502-89fb-5af2d37c14de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:43 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3a34e861-e317-4401-9637-689b3587c3a2 tempest-VolumesTransfersV355Test-547196734 None] Created volume successfully. Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Acquiring lock "cinder-5345d2d3-4e03-4301-ba74-2d2cdac4267a-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "cinder-5345d2d3-4e03-4301-ba74-2d2cdac4267a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Acquiring lock "cinder-quobyte-d28985c9-5704-440a-893d-06686a49f16d" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "cinder-quobyte-d28985c9-5704-440a-893d-06686a49f16d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Acquiring lock "cinder-quobyte-5345d2d3-4e03-4301-ba74-2d2cdac4267a" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "cinder-quobyte-5345d2d3-4e03-4301-ba74-2d2cdac4267a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Deleting offline snapshot 5345d2d3-4e03-4301-ba74-2d2cdac4267a of volume d28985c9-5704-440a-893d-06686a49f16d {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] snapshot_file for this snap is: volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac77dbcf-9bc9-4cfa-8570-9ed4d8cae407]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:43 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a Apr 24 19:23:43 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:43 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306" returned: 0 in 0.721s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:43 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306 Apr 24 19:23:43 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:44 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a" returned: 0 in 0.772s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d28985c9-5704-440a-893d-06686a49f16d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2073b2-dde7-402b-b9b8-b97c11950273]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:44 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9760fe36-8e5d-41db-9201-3dc8ac5de306" returned: 0 in 0.717s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-quobyte-9760fe36-8e5d-41db-9201-3dc8ac5de306" released by "delete_volume" :: held 1.508s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:44 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d Apr 24 19:23:44 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Created reservations ['65ffdeb0-d94d-4e45-b562-32cc6ea2000a', '7370bba2-d59c-436d-9f8b-ace97a479a69', '8065f966-8c2c-4983-91e7-01f3d39387df', 'ffda4d26-eb0d-494f-9508-541232f48cbf'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:44 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:44 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:45 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d576cbb5-0697-4715-8ce0-e91a981c93e3 tempest-VolumesTransfersV355Test-737045477 None] Transfer volume completed successfully. Apr 24 19:23:45 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d" returned: 0 in 1.106s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:45 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a Apr 24 19:23:45 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:45 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.895s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:45 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:45 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Deleted volume successfully. Apr 24 19:23:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a76d4b85-2e21-4ea5-acf5-586a344a92c3 tempest-CinderUnicodeTest-1746804574 None] Lock "cinder-9760fe36-8e5d-41db-9201-3dc8ac5de306-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:46 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a" returned: 0 in 0.896s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:46 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a Apr 24 19:23:46 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Acquiring lock "cinder-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Lock "cinder-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Acquiring lock "cinder-quobyte-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Lock "cinder-quobyte-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf" acquired by "delete_volume" :: waited 0.029s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:46 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25ac218-13a4-4100-b017-2193dad4e99d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:47 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf Apr 24 19:23:47 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:47 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d.5345d2d3-4e03-4301-ba74-2d2cdac4267a" returned: 0 in 0.907s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "cinder-quobyte-5345d2d3-4e03-4301-ba74-2d2cdac4267a" released by "_delete_snapshot" :: held 3.816s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "cinder-quobyte-d28985c9-5704-440a-893d-06686a49f16d" released by "delete_snapshot" :: held 3.852s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:47 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Created reservations ['f3941667-710e-4b41-8fa8-ae6d53874432', 'dee1881c-b528-4bfc-b766-09379d9e6eed', '7ee82f0a-7c46-4424-b1f1-a921c130d593', 'a20e14d1-cc8a-49dd-b9d4-03a96575a767'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:47 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Delete snapshot completed successfully. Apr 24 19:23:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-48026224-c776-4579-a758-8461d0fc23e0 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "cinder-5345d2d3-4e03-4301-ba74-2d2cdac4267a-delete_snapshot" released by "delete_snapshot" :: held 4.033s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:47 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf" returned: 0 in 0.834s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:47 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf Apr 24 19:23:47 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Acquiring lock "cinder-d28985c9-5704-440a-893d-06686a49f16d-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "cinder-d28985c9-5704-440a-893d-06686a49f16d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Acquiring lock "cinder-quobyte-d28985c9-5704-440a-893d-06686a49f16d" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "cinder-quobyte-d28985c9-5704-440a-893d-06686a49f16d" acquired by "delete_volume" :: waited 0.032s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[38237e86-dbd4-4827-9ab1-cbf2372d106d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:48 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d Apr 24 19:23:48 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:48 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf" returned: 0 in 0.583s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Lock "cinder-quobyte-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf" released by "delete_volume" :: held 1.512s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Created reservations ['97c9c1a6-8785-482e-b3d5-81347ca5ea05', '0edc2580-7d73-4741-945f-0e43d1202c0a', '10ca1328-79de-4ac3-880f-ef997f809507', '4f2dd51e-3f5f-45c9-bcf3-19c0030bc796'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:48 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:48 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:48 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d" returned: 0 in 0.791s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:48 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d Apr 24 19:23:48 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:49 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.656s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Deleted volume successfully. Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=140,cinder:SELECT=121,cinder:INSERT=37,cinder:DELETE=10 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9aa5572c-a2fc-4a6e-a42c-97543cb3432e tempest-VolumesTransfersV355Test-1244659878 None] Lock "cinder-dcb66f07-f440-4bc9-92e1-7cca5c15e9bf-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:49 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d28985c9-5704-440a-893d-06686a49f16d" returned: 0 in 0.638s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "cinder-quobyte-d28985c9-5704-440a-893d-06686a49f16d" released by "delete_volume" :: held 1.514s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Created reservations ['1e68cfdd-021a-4b2f-91a0-322877de5643', '5a8a22e8-8e63-40b8-a87d-bb57396330af', '6fdd00e2-fa26-4e6b-ba33-67edd7ba1233', '00904409-666a-4c29-8651-e3dade34ac0f'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:49 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:49 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Flow 'volume_create_manager' (807d50a9-eeb9-4aa6-9c12-41d2a85921d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1263c8-09f9-42df-953f-e38c6b9de758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1263c8-09f9-42df-953f-e38c6b9de758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-735470144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260e0217-0f2a-4d33-b779-fc7cc221dc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5aeac4e93344c2b2562b18ad1f48b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:50Z,use_quota=True,user_id='b4aa23675f6c490d8ffd0ea89b1a741d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d324d29-85cf-4713-b285-ad02b8d3ad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d324d29-85cf-4713-b285-ad02b8d3ad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdc13d2-e98a-4b5e-b94c-94a0bbbb7156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdc13d2-e98a-4b5e-b94c-94a0bbbb7156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260e0217-0f2a-4d33-b779-fc7cc221dc1b', 'volume_name': 'volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4159ee19-bbec-4552-8489-baa79e5ae6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4159ee19-bbec-4552-8489-baa79e5ae6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fef4fed-e918-4a26-8aac-2b5976f93a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Volume 260e0217-0f2a-4d33-b779-fc7cc221dc1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b', 'volume_size': 1} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-735470144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260e0217-0f2a-4d33-b779-fc7cc221dc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5aeac4e93344c2b2562b18ad1f48b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:50Z,use_quota=True,user_id='b4aa23675f6c490d8ffd0ea89b1a741d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Creating volume 260e0217-0f2a-4d33-b779-fc7cc221dc1b {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:49 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:23:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:49 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b 1073741824 Apr 24 19:23:49 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:50 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.666s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:50 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:50 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Deleted volume successfully. Apr 24 19:23:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-54eebc3f-5548-49c3-8a03-f854a642e183 tempest-SnapshotMetadataTestJSON-1876782545 None] Lock "cinder-d28985c9-5704-440a-893d-06686a49f16d-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:50 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b 1073741824" returned: 0 in 0.778s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:50 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b Apr 24 19:23:50 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:51 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b" returned: 0 in 0.652s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fef4fed-e918-4a26-8aac-2b5976f93a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc36462e-e2ba-4a67-82d1-920cfe2347d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:51 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Volume volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b (260e0217-0f2a-4d33-b779-fc7cc221dc1b): created successfully Apr 24 19:23:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc36462e-e2ba-4a67-82d1-920cfe2347d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Flow 'volume_create_manager' (807d50a9-eeb9-4aa6-9c12-41d2a85921d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:51 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4b041709-5ff1-4ce7-b5b4-40f69c39ba20 tempest-VolumesTransfersV355Test-547196734 None] Created volume successfully. Apr 24 19:23:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Acquiring lock "cinder-260e0217-0f2a-4d33-b779-fc7cc221dc1b-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Lock "cinder-260e0217-0f2a-4d33-b779-fc7cc221dc1b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Acquiring lock "cinder-quobyte-260e0217-0f2a-4d33-b779-fc7cc221dc1b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Lock "cinder-quobyte-260e0217-0f2a-4d33-b779-fc7cc221dc1b" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:52 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[91580422-664f-4d31-bf9d-8b7db6f3885a]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:52 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b Apr 24 19:23:52 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:53 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b" returned: 0 in 0.811s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:53 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b Apr 24 19:23:53 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:53 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Flow 'volume_create_manager' (dbc6748c-aaff-4287-96c6-ba7dbb2511b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a5796c-2c6c-4f94-9888-49b8a39af556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a5796c-2c6c-4f94-9888-49b8a39af556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1724012768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13a6e2a25fe454a92a5a1d6f86a319c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:54Z,use_quota=True,user_id='3349808268ea419c8a79d150cc8e0c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb939c3b-6aa1-41c7-a5fe-d6b3c3379230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb939c3b-6aa1-41c7-a5fe-d6b3c3379230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad3d932-7ba3-4e5d-b911-4c5b6f91ec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad3d932-7ba3-4e5d-b911-4c5b6f91ec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85', 'volume_name': 'volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1988d492-e9df-46e3-87fa-431d20fb7959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1988d492-e9df-46e3-87fa-431d20fb7959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe59abe-fc90-4460-81ef-6fdefdbbec87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:54 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Volume a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85', 'volume_size': 1} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1724012768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13a6e2a25fe454a92a5a1d6f86a319c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:54Z,use_quota=True,user_id='3349808268ea419c8a79d150cc8e0c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Creating volume a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:54 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:54 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 1073741824 Apr 24 19:23:54 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:54 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-260e0217-0f2a-4d33-b779-fc7cc221dc1b" returned: 0 in 0.887s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Lock "cinder-quobyte-260e0217-0f2a-4d33-b779-fc7cc221dc1b" released by "delete_volume" :: held 1.776s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Created reservations ['505c1aec-1447-48af-bf86-476d849c3db9', '33cc5133-7227-4c18-8c5b-c2748fb089de', '41951555-bd69-42f8-a360-d3b944268b9d', '5f90ac21-60a6-4604-816b-23dd42a82208'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:54 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:23:54 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:55 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 1073741824" returned: 0 in 1.506s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:55 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 Apr 24 19:23:55 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:55 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.404s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:55 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:55 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Deleted volume successfully. Apr 24 19:23:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-07e41be8-f5d3-42ed-a1e5-033d607c1e91 tempest-VolumesTransfersV355Test-1244659878 None] Lock "cinder-260e0217-0f2a-4d33-b779-fc7cc221dc1b-delete_volume" released by "delete_volume" :: held 3.604s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:56 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85" returned: 0 in 1.137s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] <== create_volume: return (2731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.734s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe59abe-fc90-4460-81ef-6fdefdbbec87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da572e94-d978-4443-b178-106f267514ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:56 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Volume volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 (a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85): created successfully Apr 24 19:23:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da572e94-d978-4443-b178-106f267514ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Flow 'volume_create_manager' (dbc6748c-aaff-4287-96c6-ba7dbb2511b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-89f98057-7054-4cdc-97cb-85d906a17305 tempest-VolumesMetadataTest-1722553294 None] Created volume successfully. Apr 24 19:23:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Acquiring lock "cinder-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Lock "cinder-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Acquiring lock "cinder-quobyte-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Lock "cinder-quobyte-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:58 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e480d8-bec6-43f8-8322-fcc7cc1f270d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:58 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 Apr 24 19:23:58 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:59 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85" returned: 0 in 0.925s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:59 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85 Apr 24 19:23:59 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:00 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85" returned: 0 in 1.153s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Lock "cinder-quobyte-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85" released by "delete_volume" :: held 2.169s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:00 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Created reservations ['e97d568a-1077-4ffb-a3c4-4ceaf41b762f', '7fe33c97-db2e-42c7-afe7-ad5252ad4baa', 'f4fdb980-4d91-4fae-8cd5-351a0886d64f', '173f74f0-0f65-4d29-952d-f90fdc296c4c'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:01 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:24:01 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:01 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.840s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:01 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:01 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Deleted volume successfully. Apr 24 19:24:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5eea9ad7-acdb-47b0-8793-823b1ae1df25 tempest-VolumesMetadataTest-1722553294 None] Lock "cinder-a1ae4b0c-98cd-4927-b7ff-3a3ed38bfd85-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Flow 'volume_create_manager' (0d695dea-115f-4333-bc39-b40cd6914ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3da035-33fd-42ff-a286-6ce27561d140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3da035-33fd-42ff-a286-6ce27561d140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-333012641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33905ea5-56cd-491f-bfee-2c2eec1d3ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20feba74e4c74f95a0a8b5f7fa3c64ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:06Z,use_quota=True,user_id='bbf6693141c14c29933f0fd2c99705b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b795c23c-6044-45ac-8963-d474968db05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b795c23c-6044-45ac-8963-d474968db05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d584a13c-405d-4c0b-a1f1-d6a8d1a0bdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d584a13c-405d-4c0b-a1f1-d6a8d1a0bdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33905ea5-56cd-491f-bfee-2c2eec1d3ac0', 'volume_name': 'volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1341c586-0a39-46f0-8745-129b82db5253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1341c586-0a39-46f0-8745-129b82db5253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5701dc-3e6e-4ec2-b9f5-5e4594d47a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:06 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Volume 33905ea5-56cd-491f-bfee-2c2eec1d3ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0', 'volume_size': 1} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-333012641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33905ea5-56cd-491f-bfee-2c2eec1d3ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20feba74e4c74f95a0a8b5f7fa3c64ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:06Z,use_quota=True,user_id='bbf6693141c14c29933f0fd2c99705b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Creating volume 33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:06 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:24:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:06 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 1073741824 Apr 24 19:24:06 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:07 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 1073741824" returned: 0 in 0.857s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:07 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 Apr 24 19:24:07 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Flow 'volume_create_manager' (b5b1ba31-2df4-401b-a8fd-87f3ca7d3e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecba6f6-1cda-4d73-8fd4-9fb997a39569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecba6f6-1cda-4d73-8fd4-9fb997a39569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1708610502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b0fb13-c31f-46d2-87ff-fbb297e21388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9662865da0c54b9f9dba6bfcdcac10cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:08Z,use_quota=True,user_id='7819b357b2f84dcc88b0f63a26bafd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f4126d-84da-4eee-87f3-b37be1790a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f4126d-84da-4eee-87f3-b37be1790a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddec1ef6-a912-4fb6-bb16-d2dbe4d41b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddec1ef6-a912-4fb6-bb16-d2dbe4d41b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b0fb13-c31f-46d2-87ff-fbb297e21388', 'volume_name': 'volume-23b0fb13-c31f-46d2-87ff-fbb297e21388', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bca0f1-39ae-4f8e-aeda-4008a960479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bca0f1-39ae-4f8e-aeda-4008a960479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6ade5d-820f-4544-b9e7-a4a6f255bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:08 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Volume 23b0fb13-c31f-46d2-87ff-fbb297e21388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b0fb13-c31f-46d2-87ff-fbb297e21388', 'volume_size': 1} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:08 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0" returned: 0 in 0.735s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1708610502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b0fb13-c31f-46d2-87ff-fbb297e21388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9662865da0c54b9f9dba6bfcdcac10cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:08Z,use_quota=True,user_id='7819b357b2f84dcc88b0f63a26bafd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Creating volume 23b0fb13-c31f-46d2-87ff-fbb297e21388 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:08 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5701dc-3e6e-4ec2-b9f5-5e4594d47a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:08 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388 1073741824 Apr 24 19:24:08 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15faf29e-d4f2-4827-aa27-00d5d75ca078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:08 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Volume volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 (33905ea5-56cd-491f-bfee-2c2eec1d3ac0): created successfully Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15faf29e-d4f2-4827-aa27-00d5d75ca078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Flow 'volume_create_manager' (0d695dea-115f-4333-bc39-b40cd6914ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:08 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f52e0007-33ba-43fd-9424-3b6f2cdfca82 tempest-VolumesCloneTest-2139654777 None] Created volume successfully. Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:09 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388 1073741824" returned: 0 in 0.862s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Flow 'volume_create_manager' (b0016f69-b197-4222-8f33-101d5a83d123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3a28ae-9072-49fc-bb46-8928f51b95bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3a28ae-9072-49fc-bb46-8928f51b95bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-16471454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7e8c4a-6b09-40df-b612-e8d144a3740e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20feba74e4c74f95a0a8b5f7fa3c64ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=33905ea5-56cd-491f-bfee-2c2eec1d3ac0,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:09Z,use_quota=True,user_id='bbf6693141c14c29933f0fd2c99705b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1a8523-3bcd-4892-9d46-80b94a541f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1a8523-3bcd-4892-9d46-80b94a541f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd592ba-aad9-40ed-98cb-3199f7b042bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd592ba-aad9-40ed-98cb-3199f7b042bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6e7e8c4a-6b09-40df-b612-e8d144a3740e', 'volume_name': 'volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e', 'volume_size': 2, 'source_volid': '33905ea5-56cd-491f-bfee-2c2eec1d3ac0', 'source_volstatus': 'available'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5033da0-41a9-4922-9511-a3bf4a9a52de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5033da0-41a9-4922-9511-a3bf4a9a52de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4353e1-a044-41db-a793-3b5322dbf47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:09 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Volume 6e7e8c4a-6b09-40df-b612-e8d144a3740e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e', 'volume_size': 2, 'source_volid': '33905ea5-56cd-491f-bfee-2c2eec1d3ac0', 'source_volstatus': 'available'} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:09 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388 Apr 24 19:24:09 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:09 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388" returned: 0 in 0.586s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.582s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:09 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Cloning volume 33905ea5-56cd-491f-bfee-2c2eec1d3ac0 to volume 6e7e8c4a-6b09-40df-b612-e8d144a3740e Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6ade5d-820f-4544-b9e7-a4a6f255bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b0fb13-c31f-46d2-87ff-fbb297e21388', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458a1b04-b508-4826-9408-5606e13f649e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:09 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Volume volume-23b0fb13-c31f-46d2-87ff-fbb297e21388 (23b0fb13-c31f-46d2-87ff-fbb297e21388): created successfully Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458a1b04-b508-4826-9408-5606e13f649e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Flow 'volume_create_manager' (b5b1ba31-2df4-401b-a8fd-87f3ca7d3e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Creating offline snapshot 459afea8-9cfe-43ee-8696-13beb181ada5 of volume 33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:24:09 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d05b16bf-5acd-4884-9a19-f0a37fe8bf17 tempest-VolumesTransfersTest-1907494033 None] Created volume successfully. Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4bc16a-5759-4bd5-b722-4f846a52c567]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:10 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 Apr 24 19:24:10 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:10 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-6b35d554-96f7-4b69-9d56-e3ec59b32078 tempest-VolumesTransfersTest-2118675929 None] Transfer volume completed successfully. Apr 24 19:24:10 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0" returned: 0 in 1.018s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:10 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 1G Apr 24 19:24:11 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:11 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 1G" returned: 0 in 0.915s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:11 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 Apr 24 19:24:11 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Acquiring lock "cinder-23b0fb13-c31f-46d2-87ff-fbb297e21388-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Lock "cinder-23b0fb13-c31f-46d2-87ff-fbb297e21388-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Acquiring lock "cinder-quobyte-23b0fb13-c31f-46d2-87ff-fbb297e21388" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Lock "cinder-quobyte-23b0fb13-c31f-46d2-87ff-fbb297e21388" acquired by "delete_volume" :: waited 0.028s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:12 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb05b37-e98f-4638-bb45-8b92c58c20da]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:12 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388 Apr 24 19:24:12 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:12 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5" returned: 0 in 0.947s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:12 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 is being set with open permissions: ugo+rw Apr 24 19:24:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:12 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 Apr 24 19:24:12 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:13 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388" returned: 0 in 0.862s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:13 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388 Apr 24 19:24:13 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:13 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5" returned: 0 in 0.861s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:13 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.info Apr 24 19:24:13 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:13 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23b0fb13-c31f-46d2-87ff-fbb297e21388" returned: 0 in 0.745s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Lock "cinder-quobyte-23b0fb13-c31f-46d2-87ff-fbb297e21388" released by "delete_volume" :: held 1.686s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Created reservations ['fd62990f-b818-4d18-9df1-1c1ab01d7082', '4ff988a3-f454-4b69-84cf-cf53529882e4', '7eb69d4b-d98d-485f-9c2b-edd7f6d64aae', '5963ac9e-fb2f-48ce-93fc-aa70afe69997'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:14 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:24:14 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:14 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.info" returned: 0 in 0.733s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:14 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.info is being set with open permissions: ugo+rw Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:14 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.info Apr 24 19:24:14 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:14 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.801s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:14 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:14 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Deleted volume successfully. Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-518fa793-4e71-4497-a6b4-9526f6850086 tempest-VolumesTransfersTest-774124211 None] Lock "cinder-23b0fb13-c31f-46d2-87ff-fbb297e21388-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Flow 'volume_create_manager' (4f536804-c280-4761-9aad-88f4259cab94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91c878f-5647-4030-8948-80c580d337d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91c878f-5647-4030-8948-80c580d337d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1944164555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3ebed1-2431-4814-9be9-5354d43fa6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9662865da0c54b9f9dba6bfcdcac10cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:15Z,use_quota=True,user_id='7819b357b2f84dcc88b0f63a26bafd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995e1e41-7da0-4fda-9bc2-907077d6f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995e1e41-7da0-4fda-9bc2-907077d6f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75454ad2-274e-4fec-9fb7-84bdbab64224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75454ad2-274e-4fec-9fb7-84bdbab64224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3ebed1-2431-4814-9be9-5354d43fa6ff', 'volume_name': 'volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c703a1ae-512f-4b9e-85d0-e2c04ee99064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c703a1ae-512f-4b9e-85d0-e2c04ee99064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77a9fbc-2016-4efd-9289-a842bf0341b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:15 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Volume ba3ebed1-2431-4814-9be9-5354d43fa6ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff', 'volume_size': 1} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:15 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.info" returned: 0 in 0.823s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Acquiring lock "cinder-quobyte-6e7e8c4a-6b09-40df-b612-e8d144a3740e" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Lock "cinder-quobyte-6e7e8c4a-6b09-40df-b612-e8d144a3740e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] snapshot: 459afea8-9cfe-43ee-8696-13beb181ada5, volume: 6e7e8c4a-6b09-40df-b612-e8d144a3740e, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd0ec45-c973-4b9a-a43e-dbf73c34075b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:15 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 Apr 24 19:24:15 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:16 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5" returned: 0 in 0.783s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:24:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:24:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:24:16 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[277ab731-f9be-4325-a851-9ceb6276eeef]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:16 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 Apr 24 19:24:16 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:16 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0" returned: 0 in 0.612s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:16 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:24:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:16 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e Apr 24 19:24:16 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Acquiring lock "cinder-78744421-de9e-4fb6-bc54-8a5238d3e945-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Lock "cinder-78744421-de9e-4fb6-bc54-8a5238d3e945-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:19 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Flow 'volume_create_manager' (fcb0d89d-f7b8-4635-bd3c-44467296ed8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d6e800-69c1-4e28-9af6-f33c02e88c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Acquiring lock "cinder-quobyte-78744421-de9e-4fb6-bc54-8a5238d3e945" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Lock "cinder-quobyte-78744421-de9e-4fb6-bc54-8a5238d3e945" acquired by "delete_volume" :: waited 0.064s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d6e800-69c1-4e28-9af6-f33c02e88c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1486273871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19c0163-214e-4589-bda6-5260bc37ca7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3decd5935c404e1d80e6a990c421b2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:20Z,use_quota=True,user_id='d44594c8c7f94b22a5a325717c4667f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ccdee6-cb59-4f5e-b0f7-a790f23470ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ccdee6-cb59-4f5e-b0f7-a790f23470ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3add686-c255-44d4-98fe-2cf45c6025c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3add686-c255-44d4-98fe-2cf45c6025c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19c0163-214e-4589-bda6-5260bc37ca7a', 'volume_name': 'volume-d19c0163-214e-4589-bda6-5260bc37ca7a', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4910e8-e811-46ad-9b35-307e13b1b7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4910e8-e811-46ad-9b35-307e13b1b7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5a9e96-eddb-469b-b09d-ff78ecade391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:20 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Volume d19c0163-214e-4589-bda6-5260bc37ca7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19c0163-214e-4589-bda6-5260bc37ca7a', 'volume_size': 1} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f85ffc-8924-4dbf-a6b5-d530dece6274]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:20 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945 Apr 24 19:24:20 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:21 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945" returned: 0 in 1.259s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:21 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945 Apr 24 19:24:21 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:22 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-78744421-de9e-4fb6-bc54-8a5238d3e945" returned: 0 in 0.902s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Lock "cinder-quobyte-78744421-de9e-4fb6-bc54-8a5238d3e945" released by "delete_volume" :: held 2.494s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Created reservations ['1c389c35-f351-41f3-92c9-ea8eb494d897', '7586732a-4565-4e11-a0be-a6b1c61073b3', '7b5a1dce-c21b-410f-921c-116a180bce3e', 'ef13bb23-420e-446b-a973-39caedcfc49f'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:22 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:24:22 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:22 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e" returned: 0 in 6.083s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[94efd3c9-845f-4284-b785-884c02401e4e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:22 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 Apr 24 19:24:22 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:23 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.589s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:23 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:23 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Deleted volume successfully. Apr 24 19:24:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5167583a-8c8d-49d1-bbca-491ab71fa429 tempest-VolumesNegativeTest-881798277 None] Lock "cinder-78744421-de9e-4fb6-bc54-8a5238d3e945-delete_volume" released by "delete_volume" :: held 3.668s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:23 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0" returned: 0 in 0.890s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:23 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:24:23 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Converted 1024.00 MB image at 168.27 MB/s Apr 24 19:24:23 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e is being set with open permissions: ugo+rw Apr 24 19:24:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:23 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e Apr 24 19:24:23 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:24 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e" returned: 0 in 0.553s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Lock "cinder-quobyte-6e7e8c4a-6b09-40df-b612-e8d144a3740e" released by "_copy_volume_from_snapshot" :: held 9.019s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Acquiring lock "cinder-quobyte-459afea8-9cfe-43ee-8696-13beb181ada5" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Lock "cinder-quobyte-459afea8-9cfe-43ee-8696-13beb181ada5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Deleting offline snapshot 459afea8-9cfe-43ee-8696-13beb181ada5 of volume 33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:24:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] snapshot_file for this snap is: volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:24:24 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acbedac-0d27-4156-9f81-6f784facac23]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:24 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 Apr 24 19:24:24 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:25 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5" returned: 0 in 0.659s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:24:25 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f6b745-30d0-4d49-bf9c-53172e407f7b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:25 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 Apr 24 19:24:25 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:25 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0" returned: 0 in 0.765s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:25 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 Apr 24 19:24:25 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:26 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5" returned: 0 in 0.722s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:26 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5 Apr 24 19:24:26 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:27 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0.459afea8-9cfe-43ee-8696-13beb181ada5" returned: 0 in 0.635s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Lock "cinder-quobyte-459afea8-9cfe-43ee-8696-13beb181ada5" released by "_delete_snapshot" :: held 2.901s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.520s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.080s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1944164555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3ebed1-2431-4814-9be9-5354d43fa6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9662865da0c54b9f9dba6bfcdcac10cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:15Z,use_quota=True,user_id='7819b357b2f84dcc88b0f63a26bafd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Creating volume ba3ebed1-2431-4814-9be9-5354d43fa6ff {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:27 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:27 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff 1073741824 Apr 24 19:24:27 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4353e1-a044-41db-a793-3b5322dbf47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e', 'volume_size': 2, 'source_volid': '33905ea5-56cd-491f-bfee-2c2eec1d3ac0', 'source_volstatus': 'available'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dc8d56-7618-4a29-9eb3-265cb6db04d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:27 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Volume volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e (6e7e8c4a-6b09-40df-b612-e8d144a3740e): created successfully Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dc8d56-7618-4a29-9eb3-265cb6db04d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Flow 'volume_create_manager' (b0016f69-b197-4222-8f33-101d5a83d123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:27 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-78f3d6f6-6d79-4e20-9496-bdd5a6b6794d tempest-VolumesCloneTest-2139654777 None] Created volume successfully. Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Acquiring lock "cinder-6e7e8c4a-6b09-40df-b612-e8d144a3740e-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Lock "cinder-6e7e8c4a-6b09-40df-b612-e8d144a3740e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Acquiring lock "cinder-quobyte-6e7e8c4a-6b09-40df-b612-e8d144a3740e" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Lock "cinder-quobyte-6e7e8c4a-6b09-40df-b612-e8d144a3740e" acquired by "delete_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[97500751-98ab-42be-869d-00cbb412356c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:28 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e Apr 24 19:24:28 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:28 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff 1073741824" returned: 0 in 0.886s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:28 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff Apr 24 19:24:28 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:28 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e" returned: 0 in 0.689s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:28 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e Apr 24 19:24:28 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:28 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff" returned: 0 in 0.545s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.390s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1486273871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19c0163-214e-4589-bda6-5260bc37ca7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3decd5935c404e1d80e6a990c421b2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:20Z,use_quota=True,user_id='d44594c8c7f94b22a5a325717c4667f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Creating volume d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:28 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77a9fbc-2016-4efd-9289-a842bf0341b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca129fc7-138f-4975-b053-31228f69e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:28 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a 1073741824 Apr 24 19:24:28 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:28 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Volume volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff (ba3ebed1-2431-4814-9be9-5354d43fa6ff): created successfully Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca129fc7-138f-4975-b053-31228f69e02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Flow 'volume_create_manager' (4f536804-c280-4761-9aad-88f4259cab94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c7d44695-2da5-45af-9632-1bd29bb26062 tempest-VolumesTransfersTest-1907494033 None] Created volume successfully. Apr 24 19:24:29 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6e7e8c4a-6b09-40df-b612-e8d144a3740e" returned: 0 in 0.730s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Lock "cinder-quobyte-6e7e8c4a-6b09-40df-b612-e8d144a3740e" released by "delete_volume" :: held 1.474s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Created reservations ['8011e16b-6f8d-4fe0-ab8a-c0c4416e9f22', '5fc79adb-0d02-4e28-b86b-72d5371d3828', 'bfba0bc7-1596-483b-9b27-d1a509d9e602', '5c375945-e6ec-46ea-b6c9-4560381cb37f'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:29 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:24:29 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:29 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a 1073741824" returned: 0 in 0.957s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:29 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a Apr 24 19:24:29 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Acquiring lock "cinder-ba3ebed1-2431-4814-9be9-5354d43fa6ff-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Lock "cinder-ba3ebed1-2431-4814-9be9-5354d43fa6ff-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Acquiring lock "cinder-quobyte-ba3ebed1-2431-4814-9be9-5354d43fa6ff" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Lock "cinder-quobyte-ba3ebed1-2431-4814-9be9-5354d43fa6ff" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f11ea91-d8a9-47b0-8f3e-2972c1722e0d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:30 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff Apr 24 19:24:30 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Acquiring lock "cinder-33905ea5-56cd-491f-bfee-2c2eec1d3ac0-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Lock "cinder-33905ea5-56cd-491f-bfee-2c2eec1d3ac0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Acquiring lock "cinder-quobyte-33905ea5-56cd-491f-bfee-2c2eec1d3ac0" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Lock "cinder-quobyte-33905ea5-56cd-491f-bfee-2c2eec1d3ac0" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[1811e443-a64e-4af4-b4a4-08adf0423a56]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:30 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 Apr 24 19:24:30 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:30 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:30 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a" returned: 0 in 0.793s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5a9e96-eddb-469b-b09d-ff78ecade391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19c0163-214e-4589-bda6-5260bc37ca7a', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1cfd548-7ce7-4130-b6f2-f7a6c7bc790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.980s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:30 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Deleted volume successfully. Apr 24 19:24:30 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Volume volume-d19c0163-214e-4589-bda6-5260bc37ca7a (d19c0163-214e-4589-bda6-5260bc37ca7a): created successfully Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1cfd548-7ce7-4130-b6f2-f7a6c7bc790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Flow 'volume_create_manager' (fcb0d89d-f7b8-4635-bd3c-44467296ed8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:30 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b929476b-8d06-455a-811c-2e8224281272 tempest-SnapshotDependencyTests-1952441857 None] Created volume successfully. Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d697c070-af0c-4c3d-b513-0def6801fad5 tempest-VolumesCloneTest-2139654777 None] Lock "cinder-6e7e8c4a-6b09-40df-b612-e8d144a3740e-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:30 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff" returned: 0 in 0.779s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:30 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff Apr 24 19:24:30 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:31 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0" returned: 0 in 0.762s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:31 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0 Apr 24 19:24:31 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:31 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ba3ebed1-2431-4814-9be9-5354d43fa6ff" returned: 0 in 0.703s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Lock "cinder-quobyte-ba3ebed1-2431-4814-9be9-5354d43fa6ff" released by "delete_volume" :: held 1.540s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Created reservations ['fb6ff3bb-a712-4371-b615-882a915507b8', 'e06ada8e-41a5-4211-ab04-7c85f47cfce4', '42a6409b-0488-424b-bd29-1715789a094e', '8ab93c6a-e3af-4706-9088-bd365c8ed473'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:31 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:24:31 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:31 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-33905ea5-56cd-491f-bfee-2c2eec1d3ac0" returned: 0 in 0.632s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Lock "cinder-quobyte-33905ea5-56cd-491f-bfee-2c2eec1d3ac0" released by "delete_volume" :: held 1.500s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:31 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Created reservations ['67525187-9fa5-4e85-be37-ffdccde0dd05', 'e8bc4b0c-3e46-41f1-9168-1d7366f414da', '6148e51a-1e1f-43ac-90bc-91902db82f55', 'f5d3f7bb-34af-409e-97a3-0b7b8bee8d95'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:32 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:24:32 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Creating offline snapshot 44494121-9c26-4f35-ad01-7ca3a565787e of volume d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff6735c-78d6-4239-a983-bdd8e8e235ac]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:32 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a Apr 24 19:24:32 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:32 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.746s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:32 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Deleted volume successfully. Apr 24 19:24:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-70e5ca18-b6f1-43b0-9fe1-89b46e1bbab6 tempest-VolumesTransfersTest-774124211 None] Lock "cinder-ba3ebed1-2431-4814-9be9-5354d43fa6ff-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:33 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.889s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:33 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:33 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a" returned: 0 in 0.793s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:33 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Deleted volume successfully. Apr 24 19:24:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7f04add-282e-4925-8fd5-7eb125680e13 tempest-VolumesCloneTest-2139654777 None] Lock "cinder-33905ea5-56cd-491f-bfee-2c2eec1d3ac0-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:33 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e 1G Apr 24 19:24:33 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:34 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e 1G" returned: 0 in 1.023s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19c0163-214e-4589-bda6-5260bc37ca7a -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:34 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19c0163-214e-4589-bda6-5260bc37ca7a -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e Apr 24 19:24:34 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:34 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19c0163-214e-4589-bda6-5260bc37ca7a -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e" returned: 0 in 0.669s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:34 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e is being set with open permissions: ugo+rw Apr 24 19:24:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:34 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e Apr 24 19:24:34 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:35 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e" returned: 0 in 0.578s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:35 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.info Apr 24 19:24:35 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:36 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.info" returned: 0 in 0.608s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:36 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.info is being set with open permissions: ugo+rw Apr 24 19:24:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:36 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.info Apr 24 19:24:36 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:36 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.info" returned: 0 in 0.640s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.478s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:36 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=124,cinder:SELECT=83,cinder:DELETE=8,cinder:INSERT=37 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:24:36 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-22bbdca4-0dbc-43ce-a151-8d8cc32b215a tempest-SnapshotDependencyTests-1952441857 None] Create snapshot completed successfully Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Flow 'volume_create_manager' (a947a9bf-ca01-4542-96e0-e23e164c262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b5bc6c-adbc-4703-8d21-1767524a80ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b5bc6c-adbc-4703-8d21-1767524a80ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea168d17-f4fa-4413-86f5-ec6d12a8e8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3decd5935c404e1d80e6a990c421b2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=44494121-9c26-4f35-ad01-7ca3a565787e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:38Z,use_quota=True,user_id='d44594c8c7f94b22a5a325717c4667f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91e2948-7696-48e2-9763-e0f6574c8f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91e2948-7696-48e2-9763-e0f6574c8f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363313d4-a5a9-496c-b9f7-4079f2b684c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363313d4-a5a9-496c-b9f7-4079f2b684c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea168d17-f4fa-4413-86f5-ec6d12a8e8b2', 'volume_name': 'volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2', 'volume_size': 1, 'snapshot_id': '44494121-9c26-4f35-ad01-7ca3a565787e'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e55e2ae-23d9-47cf-92cb-9a8983618b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e55e2ae-23d9-47cf-92cb-9a8983618b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c193c614-9238-4e1d-b02a-29092b9b2786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:38 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Volume ea168d17-f4fa-4413-86f5-ec6d12a8e8b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2', 'volume_size': 1, 'snapshot_id': '44494121-9c26-4f35-ad01-7ca3a565787e'} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "cinder-quobyte-44494121-9c26-4f35-ad01-7ca3a565787e-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" by "_create_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-44494121-9c26-4f35-ad01-7ca3a565787e-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Creating volume ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 from snapshot 44494121-9c26-4f35-ad01-7ca3a565787e {{(pid=81943) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "cinder-quobyte-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] snapshot: 44494121-9c26-4f35-ad01-7ca3a565787e, volume: ea168d17-f4fa-4413-86f5-ec6d12a8e8b2, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a7fef4-f9fe-465f-a3ce-836f0f3a3072]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:38 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e Apr 24 19:24:38 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:39 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e" returned: 0 in 0.710s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d19c0163-214e-4589-bda6-5260bc37ca7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:24:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:24:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:24:39 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e497e7d6-887d-4456-bd47-69d106693e83]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:39 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a Apr 24 19:24:39 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:39 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a" returned: 0 in 0.616s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:39 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:24:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:39 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 Apr 24 19:24:39 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:24:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:41 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:24:41 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:41 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.043s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:41 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Flow 'volume_create_manager' (f274bf7d-31b8-43fb-a9e7-29eb5f307b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20821870-fb82-44ea-9477-ae0965b491a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20821870-fb82-44ea-9477-ae0965b491a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1111540138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15fb2dd8-f3ea-4335-9d22-7ef0d087ea51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe911427e28941479ac351990aee978b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:44Z,use_quota=True,user_id='6932edd4763e4ad28f91f32809e29e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33acb76b-7d6b-432b-ae97-7226823b8ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33acb76b-7d6b-432b-ae97-7226823b8ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ff4679-4a71-48fd-b709-8a248bceee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ff4679-4a71-48fd-b709-8a248bceee38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15fb2dd8-f3ea-4335-9d22-7ef0d087ea51', 'volume_name': 'volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a045b3-c069-4afc-9164-1b3ad96596f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a045b3-c069-4afc-9164-1b3ad96596f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ef5350-fb14-4967-88d6-5263519eddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Volume 15fb2dd8-f3ea-4335-9d22-7ef0d087ea51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51', 'volume_size': 1} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Flow 'volume_create_manager' (718dc22e-b611-4460-9c84-b0d827f4ccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12df9e38-b21f-47ba-880d-501fa5b7b572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12df9e38-b21f-47ba-880d-501fa5b7b572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1068212060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1d8aab-9e05-49da-9564-6d04db7d0393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10838f8388e243b5980bee0388d3f234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:44Z,use_quota=True,user_id='dcf09b74ffd84458abf0fb6f630e217e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b0f003-08be-48b3-9b64-a015a4ecfcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b0f003-08be-48b3-9b64-a015a4ecfcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b326faa-d030-43f8-98d7-6b865ab9754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b326faa-d030-43f8-98d7-6b865ab9754f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce1d8aab-9e05-49da-9564-6d04db7d0393', 'volume_name': 'volume-ce1d8aab-9e05-49da-9564-6d04db7d0393', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfaaf8f-4d30-4e2a-a467-a268ed9b7260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfaaf8f-4d30-4e2a-a467-a268ed9b7260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e084698-486b-4ed1-8f82-a0dedbb169c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:44 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Volume ce1d8aab-9e05-49da-9564-6d04db7d0393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce1d8aab-9e05-49da-9564-6d04db7d0393', 'volume_size': 1} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:44 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" returned: 0 in 5.060s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfee1bfc-a59f-4a54-8fea-dcdb74041ba4]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:45 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a Apr 24 19:24:45 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:45 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a" returned: 0 in 0.854s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:45 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:24:45 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Converted 1024.00 MB image at 202.33 MB/s Apr 24 19:24:45 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 is being set with open permissions: ugo+rw Apr 24 19:24:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:45 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 Apr 24 19:24:45 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:46 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" returned: 0 in 0.543s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" released by "_copy_volume_from_snapshot" :: held 7.935s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-44494121-9c26-4f35-ad01-7ca3a565787e-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" released by "_create_volume_from_snapshot" :: held 8.001s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.023s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1111540138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15fb2dd8-f3ea-4335-9d22-7ef0d087ea51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe911427e28941479ac351990aee978b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:44Z,use_quota=True,user_id='6932edd4763e4ad28f91f32809e29e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Creating volume 15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:46 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:46 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 1073741824 Apr 24 19:24:46 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c193c614-9238-4e1d-b02a-29092b9b2786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2', 'volume_size': 1, 'snapshot_id': '44494121-9c26-4f35-ad01-7ca3a565787e'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489f25e7-69b2-4f22-9209-02ddfa7ead0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:46 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Volume volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 (ea168d17-f4fa-4413-86f5-ec6d12a8e8b2): created successfully Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489f25e7-69b2-4f22-9209-02ddfa7ead0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Flow 'volume_create_manager' (a947a9bf-ca01-4542-96e0-e23e164c262b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:46 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-24c9a581-b984-4fee-b530-e149b2c166c7 tempest-SnapshotDependencyTests-1952441857 None] Created volume successfully. Apr 24 19:24:47 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 1073741824" returned: 0 in 0.749s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:47 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 Apr 24 19:24:47 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "cinder-44494121-9c26-4f35-ad01-7ca3a565787e-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Flow 'volume_create_manager' (60d157cc-fa3a-4576-afeb-b4ec9f31dcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8767d0f2-a35a-42c9-a66c-8e8d558e7387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8767d0f2-a35a-42c9-a66c-8e8d558e7387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-804727042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb433d02-088c-4a16-bfc1-0e1f782d8afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740a90eb50e6422daf3c7515ec111eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:47Z,use_quota=True,user_id='efce2b7348f341659650057109b64fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3102d94-eb30-4d72-9b10-1a99dfee23ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3102d94-eb30-4d72-9b10-1a99dfee23ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf0913a-2521-4814-8a2c-f3195857039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.image.glance [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Creating Keystone auth plugin from conf {{(pid=81943) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-44494121-9c26-4f35-ad01-7ca3a565787e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "cinder-quobyte-d19c0163-214e-4589-bda6-5260bc37ca7a" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-d19c0163-214e-4589-bda6-5260bc37ca7a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "cinder-quobyte-44494121-9c26-4f35-ad01-7ca3a565787e" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:47 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-44494121-9c26-4f35-ad01-7ca3a565787e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Deleting offline snapshot 44494121-9c26-4f35-ad01-7ca3a565787e of volume d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] snapshot_file for this snap is: volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51" returned: 0 in 0.593s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8081c3-866b-48d7-9bf9-d7c757e742fa]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1068212060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1d8aab-9e05-49da-9564-6d04db7d0393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10838f8388e243b5980bee0388d3f234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:44Z,use_quota=True,user_id='dcf09b74ffd84458abf0fb6f630e217e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Creating volume ce1d8aab-9e05-49da-9564-6d04db7d0393 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:47 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:47 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 1073741824 Apr 24 19:24:47 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ef5350-fb14-4967-88d6-5263519eddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f647c75e-ff34-42ac-9332-0f50635b3238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:47 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Volume volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 (15fb2dd8-f3ea-4335-9d22-7ef0d087ea51): created successfully Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f647c75e-ff34-42ac-9332-0f50635b3238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Flow 'volume_create_manager' (f274bf7d-31b8-43fb-a9e7-29eb5f307b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:47 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c18ab317-64a7-4798-bf15-39c359263fe4 tempest-VolumesListTestJSON-146594187 None] Created volume successfully. Apr 24 19:24:47 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e Apr 24 19:24:47 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf0913a-2521-4814-8a2c-f3195857039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb433d02-088c-4a16-bfc1-0e1f782d8afc', 'volume_name': 'volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58f3c30-bb0d-429e-86ad-6f04a9eb460b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58f3c30-bb0d-429e-86ad-6f04a9eb460b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb97f544-5a4e-404f-9707-f466ad7ad712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:48 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Volume bb433d02-088c-4a16-bfc1-0e1f782d8afc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Trying to clone bb433d02-088c-4a16-bfc1-0e1f782d8afc from image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]). {{(pid=81943) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:24:48 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:24:48 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e" returned: 0 in 0.644s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d19c0163-214e-4589-bda6-5260bc37ca7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f258c45a-359a-4ceb-91c0-f2d18493d58e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6541167a-9cba-4843-97be-364206cd1b96]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:48 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a Apr 24 19:24:48 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:48 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD Apr 24 19:24:48 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:48 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 1073741824" returned: 0 in 0.838s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:48 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 Apr 24 19:24:48 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Flow 'volume_create_manager' (9bfad4f6-a1eb-4a00-a60f-b894388aa504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1407f5-3cce-47f8-a9b8-83d9bba9b390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1407f5-3cce-47f8-a9b8-83d9bba9b390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-966895804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77473e59-9636-4d5d-9719-86b5f61a06e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe911427e28941479ac351990aee978b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:49Z,use_quota=True,user_id='6932edd4763e4ad28f91f32809e29e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d133d63-bbde-4f1d-83f3-d13de5c68c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d133d63-bbde-4f1d-83f3-d13de5c68c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c790f2-35f4-409c-9587-d3f628b07f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c790f2-35f4-409c-9587-d3f628b07f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77473e59-9636-4d5d-9719-86b5f61a06e0', 'volume_name': 'volume-77473e59-9636-4d5d-9719-86b5f61a06e0', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc5a5ae-00bb-4002-a04d-442ae3c3f9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc5a5ae-00bb-4002-a04d-442ae3c3f9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f42240-f531-4bbe-92e9-76e5bda75397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Volume 77473e59-9636-4d5d-9719-86b5f61a06e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77473e59-9636-4d5d-9719-86b5f61a06e0', 'volume_size': 1} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:49 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a" returned: 0 in 0.729s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:49 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD" returned: 0 in 0.718s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Temporary image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 is fetched for user efce2b7348f341659650057109b64fb6. {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:24:49 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e Apr 24 19:24:49 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:49 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393" returned: 0 in 0.595s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.093s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-966895804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77473e59-9636-4d5d-9719-86b5f61a06e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe911427e28941479ac351990aee978b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:49Z,use_quota=True,user_id='6932edd4763e4ad28f91f32809e29e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Creating volume 77473e59-9636-4d5d-9719-86b5f61a06e0 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:49 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:49 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0 1073741824 Apr 24 19:24:49 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e084698-486b-4ed1-8f82-a0dedbb169c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1d8aab-9e05-49da-9564-6d04db7d0393', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b63551-bf86-465c-be7c-056c4394b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[49803e3e-91d0-4199-8910-c8f5b61649ba]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Volume volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 (ce1d8aab-9e05-49da-9564-6d04db7d0393): created successfully Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b63551-bf86-465c-be7c-056c4394b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Flow 'volume_create_manager' (718dc22e-b611-4460-9c84-b0d827f4ccd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=76,cinder:INSERT=13,cinder:UPDATE=104,cinder:DELETE=12 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:24:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-dcb88a27-d619-4ee2-8c4f-345eeff9534c tempest-VolumesSnapshotTestJSON-102735968 None] Created volume successfully. Apr 24 19:24:49 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD Apr 24 19:24:49 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:49 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e" returned: 0 in 0.614s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:49 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e Apr 24 19:24:49 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:50 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:50 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0 1073741824" returned: 0 in 0.817s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:50 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0 Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:50 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:50 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a.44494121-9c26-4f35-ad01-7ca3a565787e" returned: 0 in 0.651s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-44494121-9c26-4f35-ad01-7ca3a565787e" released by "_delete_snapshot" :: held 2.790s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-d19c0163-214e-4589-bda6-5260bc37ca7a" released by "delete_snapshot" :: held 2.819s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Created reservations ['4d4bf643-37b2-4d40-9c1d-e65070c42d1d', '90df247c-5087-4434-b44f-cc4e73308469', 'dfc6ff6e-e40d-4320-8fcf-0d1fccaed43c', 'e3254d7f-276a-4e67-883d-6bd14b8799ac'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:50 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Delete snapshot completed successfully. Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51a4797c-7683-46ab-97a8-41fab81270da tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-44494121-9c26-4f35-ad01-7ca3a565787e-delete_snapshot" released by "delete_snapshot" :: held 2.984s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:50 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0" returned: 0 in 0.575s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-804727042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb433d02-088c-4a16-bfc1-0e1f782d8afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740a90eb50e6422daf3c7515ec111eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:47Z,use_quota=True,user_id='efce2b7348f341659650057109b64fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Creating volume bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:50 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f42240-f531-4bbe-92e9-76e5bda75397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77473e59-9636-4d5d-9719-86b5f61a06e0', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:50 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc 1073741824 Apr 24 19:24:50 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7557169f-6a17-427c-a05b-587065ff35e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:50 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Volume volume-77473e59-9636-4d5d-9719-86b5f61a06e0 (77473e59-9636-4d5d-9719-86b5f61a06e0): created successfully Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7557169f-6a17-427c-a05b-587065ff35e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Flow 'volume_create_manager' (9bfad4f6-a1eb-4a00-a60f-b894388aa504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:50 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-8e0dcbf6-1a58-4159-a8a1-7ac796033026 tempest-VolumesListTestJSON-146594187 None] Created volume successfully. Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "cinder-d19c0163-214e-4589-bda6-5260bc37ca7a-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-d19c0163-214e-4589-bda6-5260bc37ca7a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "cinder-quobyte-d19c0163-214e-4589-bda6-5260bc37ca7a" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-d19c0163-214e-4589-bda6-5260bc37ca7a" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b428a95-21da-4aa9-b702-d5b86626b503]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:51 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a Apr 24 19:24:51 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:51 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc 1073741824" returned: 0 in 0.739s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:51 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc Apr 24 19:24:51 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:51 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a" returned: 0 in 0.655s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:51 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a Apr 24 19:24:51 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Flow 'volume_create_manager' (5d1f9734-e924-4eea-ab47-fc4793744049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6041810-ba03-4281-9cb1-1a42d5b94e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6041810-ba03-4281-9cb1-1a42d5b94e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-31088295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c0dd10-27c5-4d3f-b248-ea136d7b5a74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe911427e28941479ac351990aee978b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:52Z,use_quota=True,user_id='6932edd4763e4ad28f91f32809e29e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14d66ac-48eb-44d1-9d9f-16644e50da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14d66ac-48eb-44d1-9d9f-16644e50da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bd499f-f8b6-4f9c-b48d-70d1d7a8dd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bd499f-f8b6-4f9c-b48d-70d1d7a8dd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c0dd10-27c5-4d3f-b248-ea136d7b5a74', 'volume_name': 'volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f5186e-ca57-432a-b7b8-9b3e5b72a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f5186e-ca57-432a-b7b8-9b3e5b72a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1102cd96-4ec9-45a2-a375-78fd93a463c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:51 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Volume 40c0dd10-27c5-4d3f-b248-ea136d7b5a74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74', 'volume_size': 1} Apr 24 19:24:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:52 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc" returned: 0 in 0.516s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.885s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Attempting download of 0ac46f6e-0b50-4bf2-95dd-aa609d212809 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}])) to volume bb433d02-088c-4a16-bfc1-0e1f782d8afc. {{(pid=81943) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Creating offline snapshot 17f16841-493e-4829-b41c-df24483c80a4 of volume ce1d8aab-9e05-49da-9564-6d04db7d0393 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c8e448-6020-4294-b72c-5a05adce7b39]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bc19fa-b424-4fd2-9417-55bd222c3bbd]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_mi4ggxx2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:52 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d19c0163-214e-4589-bda6-5260bc37ca7a" returned: 0 in 0.567s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-d19c0163-214e-4589-bda6-5260bc37ca7a" released by "delete_volume" :: held 1.281s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:52 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 Apr 24 19:24:52 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:52 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_mi4ggxx2 Apr 24 19:24:52 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Created reservations ['190a767d-3241-42b3-ad2b-7485640c0a76', 'a7c32cfc-12ee-4366-90a6-af89299829bb', '0466ea90-6962-465f-b607-b4c282d02a0d', '0f221f77-d5b1-4d03-82ed-2129caea0d7e'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:52 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:24:52 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:52 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_mi4ggxx2" returned: 0 in 0.538s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_mi4ggxx2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:52 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393" returned: 0 in 0.599s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:52 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 1G Apr 24 19:24:52 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:52 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_mi4ggxx2 Apr 24 19:24:52 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:52 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.482s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Deleted volume successfully. Apr 24 19:24:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c08f1e1d-f2af-4e10-8ec1-699302e49c7e tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-d19c0163-214e-4589-bda6-5260bc37ca7a-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "cinder-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "cinder-quobyte-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9b8c76-38bc-4152-95b7-d68c690bb5bd]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:53 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 Apr 24 19:24:53 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:53 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_mi4ggxx2" returned: 1 in 0.589s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_mi4ggxx2' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[68300d57-9a76-4a2b-a3c9-50ea7b8e911a]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:53 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD Apr 24 19:24:53 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:53 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 1G" returned: 0 in 0.700s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:53 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 Apr 24 19:24:53 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:53 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" returned: 0 in 0.591s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:53 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2 Apr 24 19:24:53 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:53 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD" returned: 0 in 0.602s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] 0ac46f6e-0b50-4bf2-95dd-aa609d212809 was qcow2, converting to raw {{(pid=81943) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:53 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc Apr 24 19:24:53 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:53 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4" returned: 0 in 0.564s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:53 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 is being set with open permissions: ugo+rw Apr 24 19:24:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:54 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 Apr 24 19:24:54 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:54 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" returned: 0 in 0.515s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-quobyte-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2" released by "delete_volume" :: held 1.146s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Created reservations ['448f6112-aab7-42f7-a05e-0cb360e90cc5', 'c088c95b-b440-475d-89ee-7109da9c4f05', '05d25986-45e2-4678-b88d-e928c3d11553', 'b3f7bc9c-9078-44c2-9d84-b8ec615e8ff0'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:54 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:24:54 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:54 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4" returned: 0 in 0.520s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:54 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.info Apr 24 19:24:54 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:55 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.650s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:55 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:55 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Deleted volume successfully. Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.info" returned: 0 in 0.551s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:55 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.info is being set with open permissions: ugo+rw Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7573b722-2dc1-46d5-af5c-59e82fed3432 tempest-SnapshotDependencyTests-1952441857 None] Lock "cinder-ea168d17-f4fa-4413-86f5-ec6d12a8e8b2-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:55 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.info Apr 24 19:24:55 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:55 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc" returned: 0 in 1.638s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_kx928a4ldevstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:24:55 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Converted 112.00 MB image at 68.32 MB/s Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:55 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc 1G Apr 24 19:24:55 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:55 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.info" returned: 0 in 0.627s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.666s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.847s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-31088295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c0dd10-27c5-4d3f-b248-ea136d7b5a74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe911427e28941479ac351990aee978b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:52Z,use_quota=True,user_id='6932edd4763e4ad28f91f32809e29e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Creating volume 40c0dd10-27c5-4d3f-b248-ea136d7b5a74 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:55 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:24:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:55 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74 1073741824 Apr 24 19:24:55 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:55 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-da540bc6-da79-409f-9d09-027946d157a2 tempest-VolumesSnapshotTestJSON-102735968 None] Create snapshot completed successfully Apr 24 19:24:56 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc 1G" returned: 0 in 0.656s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27e21d3-9259-4616-a996-30476a129006]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:56 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc Apr 24 19:24:56 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:56 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74 1073741824" returned: 0 in 0.862s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-17f16841-493e-4829-b41c-df24483c80a4-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-17f16841-493e-4829-b41c-df24483c80a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:56 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74 Apr 24 19:24:56 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-ce1d8aab-9e05-49da-9564-6d04db7d0393" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-ce1d8aab-9e05-49da-9564-6d04db7d0393" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-17f16841-493e-4829-b41c-df24483c80a4" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-17f16841-493e-4829-b41c-df24483c80a4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Deleting offline snapshot 17f16841-493e-4829-b41c-df24483c80a4 of volume ce1d8aab-9e05-49da-9564-6d04db7d0393 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] snapshot_file for this snap is: volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a6e86b-35f7-42ff-96e1-bf8989a286e6]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:56 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 Apr 24 19:24:56 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:56 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc" returned: 0 in 0.764s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:57 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc Apr 24 19:24:57 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:57 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74" returned: 0 in 0.703s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1102cd96-4ec9-45a2-a375-78fd93a463c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edecf63-a13c-4463-8a7d-4ad2c1e857ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:57 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Volume volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74 (40c0dd10-27c5-4d3f-b248-ea136d7b5a74): created successfully Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edecf63-a13c-4463-8a7d-4ad2c1e857ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Flow 'volume_create_manager' (5d1f9734-e924-4eea-ab47-fc4793744049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:57 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-ab825973-473c-4b5e-9ec9-9016f701913c tempest-VolumesListTestJSON-146594187 None] Created volume successfully. Apr 24 19:24:57 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4" returned: 0 in 0.724s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce1d8aab-9e05-49da-9564-6d04db7d0393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88ef11e-e56e-4b09-bf67-bcadac916dbc]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:57 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 Apr 24 19:24:57 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:57 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc" returned: 1 in 0.729s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Downloaded image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}])) to volume bb433d02-088c-4a16-bfc1-0e1f782d8afc successfully. {{(pid=81943) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Temporary image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 for user efce2b7348f341659650057109b64fb6 is deleted. {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Marking volume bb433d02-088c-4a16-bfc1-0e1f782d8afc as bootable. {{(pid=81943) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Copying metadata from image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 to bb433d02-088c-4a16-bfc1-0e1f782d8afc. {{(pid=81943) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Creating volume glance metadata for volume bb433d02-088c-4a16-bfc1-0e1f782d8afc backed by image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81943) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb97f544-5a4e-404f-9707-f466ad7ad712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efb88cc-e430-4a20-9ec8-b3658def0d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:57 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Volume volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc (bb433d02-088c-4a16-bfc1-0e1f782d8afc): created successfully Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efb88cc-e430-4a20-9ec8-b3658def0d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Flow 'volume_create_manager' (60d157cc-fa3a-4576-afeb-b4ec9f31dcc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:57 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-74b8fb66-28d2-470c-b734-84165c6656ed tempest-VolumesExtendTest-634185708 None] Created volume successfully. Apr 24 19:24:58 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393" returned: 0 in 0.660s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:58 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 Apr 24 19:24:58 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:58 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8920f1-c530-4caf-8872-e7df782aa74e]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:58 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc Apr 24 19:24:58 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:59 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4" returned: 0 in 0.848s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:59 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4 Apr 24 19:24:59 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:59 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc" returned: 0 in 0.693s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:59 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc Apr 24 19:24:59 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:59 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393.17f16841-493e-4829-b41c-df24483c80a4" returned: 0 in 0.727s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-17f16841-493e-4829-b41c-df24483c80a4" released by "_delete_snapshot" :: held 3.087s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-ce1d8aab-9e05-49da-9564-6d04db7d0393" released by "delete_snapshot" :: held 3.118s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:59 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Created reservations ['67dd0657-8e71-4401-97b6-c4438f31dce8', '786914d2-77ca-49b5-8343-c99a746c8b7e', 'd7a1fd44-be86-4607-814d-31b08f9f5ead', 'ae2958ae-8833-4fe7-87de-e441e8051e65'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:00 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Delete snapshot completed successfully. Apr 24 19:25:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-56624a6c-017f-4339-b36e-bfd798e064e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-17f16841-493e-4829-b41c-df24483c80a4-delete_snapshot" released by "delete_snapshot" :: held 3.349s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:00 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc" returned: 1 in 0.780s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:25:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc 2G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc 2G" returned: 0 in 0.077s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.667s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:00 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4f73618c-9e9d-4d5b-bf67-161cfdf46262 tempest-VolumesExtendTest-634185708 None] Extend volume completed successfully. Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Acquiring lock "cinder-bb433d02-088c-4a16-bfc1-0e1f782d8afc-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Lock "cinder-bb433d02-088c-4a16-bfc1-0e1f782d8afc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Acquiring lock "cinder-quobyte-bb433d02-088c-4a16-bfc1-0e1f782d8afc" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Lock "cinder-quobyte-bb433d02-088c-4a16-bfc1-0e1f782d8afc" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e646f079-4b67-4ad3-b363-0b78d89244ff]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:01 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc Apr 24 19:25:01 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Acquiring lock "cinder-40c0dd10-27c5-4d3f-b248-ea136d7b5a74-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Lock "cinder-40c0dd10-27c5-4d3f-b248-ea136d7b5a74-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Acquiring lock "cinder-quobyte-40c0dd10-27c5-4d3f-b248-ea136d7b5a74" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Lock "cinder-quobyte-40c0dd10-27c5-4d3f-b248-ea136d7b5a74" acquired by "delete_volume" :: waited 0.030s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcd569a-7989-43b8-8682-3ab80b0d506e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Flow 'volume_create_manager' (bd19fa5c-8e02-4bd9-9ecc-9e65cdbef361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19f7c8b-ba12-4c8e-a641-67e04dc028e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19f7c8b-ba12-4c8e-a641-67e04dc028e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-21713169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d420e2e1-1e49-4edd-a9bb-31c5b9533573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10838f8388e243b5980bee0388d3f234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:02Z,use_quota=True,user_id='dcf09b74ffd84458abf0fb6f630e217e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa545b00-91e6-44b5-861f-4c5d82fdc661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa545b00-91e6-44b5-861f-4c5d82fdc661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2bfa7b-0e3e-4310-9ed8-2caa74f51f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2bfa7b-0e3e-4310-9ed8-2caa74f51f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd420e2e1-1e49-4edd-a9bb-31c5b9533573', 'volume_name': 'volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:01 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74 Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55a363a-c602-4289-b909-12d196c655c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:01 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55a363a-c602-4289-b909-12d196c655c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89944cb-04b7-486e-a1c1-9b3181e01962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:01 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Volume d420e2e1-1e49-4edd-a9bb-31c5b9533573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573', 'volume_size': 1} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-21713169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d420e2e1-1e49-4edd-a9bb-31c5b9533573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10838f8388e243b5980bee0388d3f234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:02Z,use_quota=True,user_id='dcf09b74ffd84458abf0fb6f630e217e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Creating volume d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:01 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:25:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:01 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 1073741824 Apr 24 19:25:01 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:02 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc" returned: 0 in 0.768s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:02 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc Apr 24 19:25:02 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:02 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74" returned: 0 in 0.749s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:02 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74 Apr 24 19:25:02 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:02 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 1073741824" returned: 0 in 0.906s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:02 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 Apr 24 19:25:02 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:02 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc" returned: 1 in 0.744s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:25:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:02 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc Apr 24 19:25:02 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:03 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-40c0dd10-27c5-4d3f-b248-ea136d7b5a74" returned: 0 in 0.597s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Lock "cinder-quobyte-40c0dd10-27c5-4d3f-b248-ea136d7b5a74" released by "delete_volume" :: held 1.428s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Created reservations ['329f7399-2e65-4b66-bafb-36d550650a99', 'bad91adb-1998-49ae-b082-f507535f2588', '4552ef73-3be2-4eca-906d-5b7968b0a5b4', '8e8ebbce-3385-4983-89a3-cd8771f16364'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:03 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:03 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:03 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573" returned: 0 in 0.572s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89944cb-04b7-486e-a1c1-9b3181e01962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324fa1eb-3deb-4ecc-b546-081784ee8dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:03 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Volume volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 (d420e2e1-1e49-4edd-a9bb-31c5b9533573): created successfully Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324fa1eb-3deb-4ecc-b546-081784ee8dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Flow 'volume_create_manager' (bd19fa5c-8e02-4bd9-9ecc-9e65cdbef361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:03 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-dafc663f-67ff-4131-9a04-d87355686b7e tempest-VolumesSnapshotTestJSON-102735968 None] Created volume successfully. Apr 24 19:25:03 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bb433d02-088c-4a16-bfc1-0e1f782d8afc" returned: 0 in 0.646s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Lock "cinder-quobyte-bb433d02-088c-4a16-bfc1-0e1f782d8afc" released by "delete_volume" :: held 2.253s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Created reservations ['de46bd38-e912-415d-b22b-768e063660d8', '3634b0e1-501e-49cd-932b-53311d0ea1ec', 'c451e8b5-8273-45c9-8c07-d4d99772422f', 'af7f49d2-630c-4264-b5f7-b03ce4bc36db'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:03 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:03 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:03 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.598s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:03 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Deleted volume successfully. Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e5984b99-9658-4487-9595-b12ace9dd926 tempest-VolumesListTestJSON-146594187 None] Lock "cinder-40c0dd10-27c5-4d3f-b248-ea136d7b5a74-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Acquiring lock "cinder-77473e59-9636-4d5d-9719-86b5f61a06e0-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Lock "cinder-77473e59-9636-4d5d-9719-86b5f61a06e0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Acquiring lock "cinder-quobyte-77473e59-9636-4d5d-9719-86b5f61a06e0" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Lock "cinder-quobyte-77473e59-9636-4d5d-9719-86b5f61a06e0" acquired by "delete_volume" :: waited 0.033s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[842f83d3-365b-4492-95b5-8949e57af08c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Creating offline snapshot 0d1ad725-056c-4db9-b4bf-60f93d8313de of volume d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[1544ce38-29c6-4607-bcc3-10c427d8fe62]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:04 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0 Apr 24 19:25:04 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:04 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 Apr 24 19:25:04 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:04 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.796s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:04 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Deleted volume successfully. Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3d4a23a1-e360-4190-9021-7188e79389c7 tempest-VolumesExtendTest-634185708 None] Lock "cinder-bb433d02-088c-4a16-bfc1-0e1f782d8afc-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:04 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0" returned: 0 in 0.796s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:04 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0 Apr 24 19:25:04 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:04 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573" returned: 0 in 0.785s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:04 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de 1G Apr 24 19:25:04 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Flow 'volume_create_manager' (57243e41-8f92-469a-848b-4c1791b0cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a56002-40a7-427b-96db-f7dd1df96649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a56002-40a7-427b-96db-f7dd1df96649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-471767010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089d1bcf-9747-40f3-ab5d-2cf95935c293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740a90eb50e6422daf3c7515ec111eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:05Z,use_quota=True,user_id='efce2b7348f341659650057109b64fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31335cc7-5beb-40d4-8325-d61c241d5381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31335cc7-5beb-40d4-8325-d61c241d5381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd13b1a8-6761-49c8-a1d0-afd57b38092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd13b1a8-6761-49c8-a1d0-afd57b38092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089d1bcf-9747-40f3-ab5d-2cf95935c293', 'volume_name': 'volume-089d1bcf-9747-40f3-ab5d-2cf95935c293', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5308c758-f39a-4f15-9bac-b649df69f9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5308c758-f39a-4f15-9bac-b649df69f9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba3aa38-b8c7-4578-a9e7-b9ab59559e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:05 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Volume 089d1bcf-9747-40f3-ab5d-2cf95935c293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089d1bcf-9747-40f3-ab5d-2cf95935c293', 'volume_size': 1} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:05 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-77473e59-9636-4d5d-9719-86b5f61a06e0" returned: 0 in 0.641s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Lock "cinder-quobyte-77473e59-9636-4d5d-9719-86b5f61a06e0" released by "delete_volume" :: held 1.496s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Created reservations ['35b09dbf-9f4a-498b-8f79-c5c3a25f7e59', '7c9131a7-f256-4757-997c-e16118923153', 'ad1908ab-2f3d-47dc-a1de-fa36ec1121f2', '4650192e-f490-43d7-8a00-8690d09bbeb6'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:05 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:05 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:05 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de 1G" returned: 0 in 0.843s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:05 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de Apr 24 19:25:05 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:06 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.669s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:06 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:06 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Deleted volume successfully. Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de" returned: 0 in 0.639s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:06 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de is being set with open permissions: ugo+rw Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Acquiring lock "cinder-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:06 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de Apr 24 19:25:06 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-50284b2f-4a8d-4d17-beca-981fee15dbdd tempest-VolumesListTestJSON-146594187 None] Lock "cinder-77473e59-9636-4d5d-9719-86b5f61a06e0-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Lock "cinder-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Acquiring lock "cinder-quobyte-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Lock "cinder-quobyte-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51" acquired by "delete_volume" :: waited 0.028s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7ecfc6-b5d2-49d4-ab69-76ed3d935320]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:06 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 Apr 24 19:25:06 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:07 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de" returned: 0 in 0.589s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:07 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.info Apr 24 19:25:07 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:07 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51" returned: 0 in 0.607s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:07 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51 Apr 24 19:25:07 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:07 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.info" returned: 0 in 0.488s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:07 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.info is being set with open permissions: ugo+rw Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:07 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.info Apr 24 19:25:07 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:07 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51" returned: 0 in 0.516s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Lock "cinder-quobyte-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51" released by "delete_volume" :: held 1.186s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Created reservations ['2fa20d88-212b-4489-a778-5a7216c42420', '7bf5b01b-fb52-4447-a699-bc7da984b9bb', 'a3eb444f-94cf-42d8-8596-4eb212630acb', '1b70b74d-40ea-445d-806e-b4a13a68a26a'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:07 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:07 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:08 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.info" returned: 0 in 0.547s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.016s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.858s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-471767010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089d1bcf-9747-40f3-ab5d-2cf95935c293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740a90eb50e6422daf3c7515ec111eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:05Z,use_quota=True,user_id='efce2b7348f341659650057109b64fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Creating volume 089d1bcf-9747-40f3-ab5d-2cf95935c293 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:08 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:08 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 1073741824 Apr 24 19:25:08 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:08 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-2146e301-4d8a-4c49-9806-98aa7607c686 tempest-VolumesSnapshotTestJSON-102735968 None] Create snapshot completed successfully Apr 24 19:25:08 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.550s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:08 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Deleted volume successfully. Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7078abfc-2134-4771-9c92-cf594d25aff5 tempest-VolumesListTestJSON-146594187 None] Lock "cinder-15fb2dd8-f3ea-4335-9d22-7ef0d087ea51-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Flow 'volume_create_manager' (6102b6b1-efb4-4653-b2ac-f84574f89127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36abf00-9d16-4267-a61c-927590b56180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36abf00-9d16-4267-a61c-927590b56180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-829896407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6050db-0af2-40e7-9756-9535e0272ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10838f8388e243b5980bee0388d3f234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0d1ad725-056c-4db9-b4bf-60f93d8313de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:09Z,use_quota=True,user_id='dcf09b74ffd84458abf0fb6f630e217e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceded24-c4d6-4dfe-b46b-5a00dbebaecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceded24-c4d6-4dfe-b46b-5a00dbebaecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31d1c6e-29c5-47c4-a019-a800e73796e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31d1c6e-29c5-47c4-a019-a800e73796e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e6050db-0af2-40e7-9756-9535e0272ebd', 'volume_name': 'volume-8e6050db-0af2-40e7-9756-9535e0272ebd', 'volume_size': 2, 'snapshot_id': '0d1ad725-056c-4db9-b4bf-60f93d8313de'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023438ec-60e8-4a6f-9919-55feb2cc54f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023438ec-60e8-4a6f-9919-55feb2cc54f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b793fb-794a-47ab-8b08-2a6911dc9c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Volume 8e6050db-0af2-40e7-9756-9535e0272ebd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e6050db-0af2-40e7-9756-9535e0272ebd', 'volume_size': 2, 'snapshot_id': '0d1ad725-056c-4db9-b4bf-60f93d8313de'} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 1073741824" returned: 0 in 0.792s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:08 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 Apr 24 19:25:08 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:09 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293" returned: 0 in 0.527s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.556s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-0d1ad725-056c-4db9-b4bf-60f93d8313de-8e6050db-0af2-40e7-9756-9535e0272ebd" by "_create_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba3aa38-b8c7-4578-a9e7-b9ab59559e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089d1bcf-9747-40f3-ab5d-2cf95935c293', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4638fe26-c2af-42da-bd1e-137a3a92c680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-0d1ad725-056c-4db9-b4bf-60f93d8313de-8e6050db-0af2-40e7-9756-9535e0272ebd" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Creating volume 8e6050db-0af2-40e7-9756-9535e0272ebd from snapshot 0d1ad725-056c-4db9-b4bf-60f93d8313de {{(pid=81943) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-8e6050db-0af2-40e7-9756-9535e0272ebd" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:09 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Volume volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 (089d1bcf-9747-40f3-ab5d-2cf95935c293): created successfully Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4638fe26-c2af-42da-bd1e-137a3a92c680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Flow 'volume_create_manager' (57243e41-8f92-469a-848b-4c1791b0cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-8e6050db-0af2-40e7-9756-9535e0272ebd" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] snapshot: 0d1ad725-056c-4db9-b4bf-60f93d8313de, volume: 8e6050db-0af2-40e7-9756-9535e0272ebd, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:09 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f63d4da3-d3a0-4eec-bdfb-521f1418b56b tempest-VolumesExtendTest-634185708 None] Created volume successfully. Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5652b0-804e-4007-99bc-d9c6d74437fc]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:09 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de Apr 24 19:25:09 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:10 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de" returned: 0 in 0.660s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:25:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:25:10 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfb6b11-1db9-4d99-9008-c9455f1a02db]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:10 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 Apr 24 19:25:10 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:11 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573" returned: 0 in 0.749s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:11 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:25:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:11 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd Apr 24 19:25:11 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:11 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Flow 'volume_create_manager' (c6abdf23-5f49-4f54-8c2d-05c0aa48c4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:11 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4575f7e-46a1-48fa-95dc-4e6ff5d4b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4575f7e-46a1-48fa-95dc-4e6ff5d4b758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1442958307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb60099-e8d2-4525-9c61-c21f72978bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7548e1731427a903a6ad0419f1c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:12Z,use_quota=True,user_id='1e6b24d765ae46b59a1055a4e47074eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e15c0c1-08e4-4abd-a2c3-0d81b7a66344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e15c0c1-08e4-4abd-a2c3-0d81b7a66344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67133f84-d0e9-454f-a0d0-29eb08aa8870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67133f84-d0e9-454f-a0d0-29eb08aa8870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb60099-e8d2-4525-9c61-c21f72978bca', 'volume_name': 'volume-2bb60099-e8d2-4525-9c61-c21f72978bca', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cd4efa-18f9-4644-99b1-ae0b85e766bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cd4efa-18f9-4644-99b1-ae0b85e766bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:12 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02cf0e4e-b5cf-449d-9bf3-359736c5e357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:12 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Volume 2bb60099-e8d2-4525-9c61-c21f72978bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb60099-e8d2-4525-9c61-c21f72978bca', 'volume_size': 1} Apr 24 19:25:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:16 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd" returned: 0 in 5.069s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:16 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb74b5bd-8793-4fae-8bba-c5754ab73245]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:16 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 Apr 24 19:25:16 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:16 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573" returned: 0 in 0.671s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:16 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:25:16 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Converted 1024.00 MB image at 201.96 MB/s Apr 24 19:25:16 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd is being set with open permissions: ugo+rw Apr 24 19:25:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:16 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd Apr 24 19:25:16 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:17 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd" returned: 0 in 0.470s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-8e6050db-0af2-40e7-9756-9535e0272ebd" released by "_copy_volume_from_snapshot" :: held 7.743s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-0d1ad725-056c-4db9-b4bf-60f93d8313de-8e6050db-0af2-40e7-9756-9535e0272ebd" released by "_create_volume_from_snapshot" :: held 7.796s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.835s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.446s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Creating offline snapshot 7670beec-3371-4f81-9886-def838bcc29e of volume 089d1bcf-9747-40f3-ab5d-2cf95935c293 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b793fb-794a-47ab-8b08-2a6911dc9c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6050db-0af2-40e7-9756-9535e0272ebd', 'volume_size': 2, 'snapshot_id': '0d1ad725-056c-4db9-b4bf-60f93d8313de'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa91b95-2635-464e-b084-31107f7ec695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[39002726-1c6f-4ba3-bff8-723d1aeb123b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:17 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Volume volume-8e6050db-0af2-40e7-9756-9535e0272ebd (8e6050db-0af2-40e7-9756-9535e0272ebd): created successfully Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa91b95-2635-464e-b084-31107f7ec695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Flow 'volume_create_manager' (6102b6b1-efb4-4653-b2ac-f84574f89127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:17 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c9429a4e-cbf7-4991-a184-c921e653f4c8 tempest-VolumesSnapshotTestJSON-102735968 None] Created volume successfully. Apr 24 19:25:17 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 Apr 24 19:25:17 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:17 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293" returned: 0 in 0.587s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:17 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e 1G Apr 24 19:25:17 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:18 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e 1G" returned: 0 in 0.663s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-8e6050db-0af2-40e7-9756-9535e0272ebd-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:18 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e Apr 24 19:25:18 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-8e6050db-0af2-40e7-9756-9535e0272ebd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-8e6050db-0af2-40e7-9756-9535e0272ebd" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-8e6050db-0af2-40e7-9756-9535e0272ebd" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:18 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bac3ad-d445-460f-848b-0b02cf3e79f1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:18 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd Apr 24 19:25:18 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:19 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e" returned: 0 in 0.534s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:19 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e is being set with open permissions: ugo+rw Apr 24 19:25:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:19 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e Apr 24 19:25:19 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:19 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd" returned: 0 in 0.554s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:19 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd Apr 24 19:25:19 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:19 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e" returned: 0 in 0.497s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:19 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.info Apr 24 19:25:19 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:19 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8e6050db-0af2-40e7-9756-9535e0272ebd" returned: 0 in 0.543s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-8e6050db-0af2-40e7-9756-9535e0272ebd" released by "delete_volume" :: held 1.162s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:19 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Created reservations ['b7dcddac-9511-44cd-afec-3f7eb9ead17e', 'fa7e0335-9238-449e-846b-01ab3245b590', '23403ad4-d432-443e-8326-c88edbc9df88', '96ee0d19-5834-4b93-81b2-9702628d3542'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:20 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:20 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:20 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.info" returned: 0 in 0.497s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:20 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.info is being set with open permissions: ugo+rw Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:20 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.info Apr 24 19:25:20 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:20 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.501s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:20 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Deleted volume successfully. Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-96ec6263-df9b-434a-acf2-b33d48576397 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-8e6050db-0af2-40e7-9756-9535e0272ebd-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:20 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.info" returned: 0 in 0.487s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.377s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.669s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1442958307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb60099-e8d2-4525-9c61-c21f72978bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7548e1731427a903a6ad0419f1c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:12Z,use_quota=True,user_id='1e6b24d765ae46b59a1055a4e47074eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Creating volume 2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:20 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:20 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca 1073741824 Apr 24 19:25:20 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:20 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-257f5ae6-6813-4c02-8fc6-684bcd282c91 tempest-VolumesExtendTest-634185708 None] Create snapshot completed successfully Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-0d1ad725-056c-4db9-b4bf-60f93d8313de-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-0d1ad725-056c-4db9-b4bf-60f93d8313de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-d420e2e1-1e49-4edd-a9bb-31c5b9533573" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-d420e2e1-1e49-4edd-a9bb-31c5b9533573" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-0d1ad725-056c-4db9-b4bf-60f93d8313de" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-0d1ad725-056c-4db9-b4bf-60f93d8313de" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Deleting offline snapshot 0d1ad725-056c-4db9-b4bf-60f93d8313de of volume d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] snapshot_file for this snap is: volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12fde42-f6dd-4c20-a2e7-6e7d49fec3d2]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:21 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de Apr 24 19:25:21 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:21 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca 1073741824" returned: 0 in 0.771s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e6fdb0e2-eba2-4500-b6f2-554477f228f7 tempest-VolumesExtendTest-634185708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:21 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca Apr 24 19:25:21 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:21 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de" returned: 0 in 0.675s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f9fef6-40de-4f1d-82fc-dcb75d2e966f]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:21 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 Apr 24 19:25:21 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:22 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca" returned: 0 in 0.491s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e6fdb0e2-eba2-4500-b6f2-554477f228f7 tempest-VolumesExtendTest-634185708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.519s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02cf0e4e-b5cf-449d-9bf3-359736c5e357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb60099-e8d2-4525-9c61-c21f72978bca', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d24b94-200f-40d8-afab-f56cc9a38966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c92cf8-d0de-4528-b155-825ed3fde5d0]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e6fdb0e2-eba2-4500-b6f2-554477f228f7 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:22 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Volume volume-2bb60099-e8d2-4525-9c61-c21f72978bca (2bb60099-e8d2-4525-9c61-c21f72978bca): created successfully Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d24b94-200f-40d8-afab-f56cc9a38966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Flow 'volume_create_manager' (c6abdf23-5f49-4f54-8c2d-05c0aa48c4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:22 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-11ace230-6ecd-42fd-941f-90c16e9bae25 tempest-VolumesSnapshotListTestJSON-205729906 None] Created volume successfully. Apr 24 19:25:22 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 Apr 24 19:25:22 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:22 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573" returned: 0 in 0.566s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:22 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de Apr 24 19:25:22 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:22 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e6fdb0e2-eba2-4500-b6f2-554477f228f7 tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293" returned: 0 in 0.541s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e6fdb0e2-eba2-4500-b6f2-554477f228f7 tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e 2G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e6fdb0e2-eba2-4500-b6f2-554477f228f7 tempest-VolumesExtendTest-634185708 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e 2G" returned: 0 in 0.171s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e6fdb0e2-eba2-4500-b6f2-554477f228f7 tempest-VolumesExtendTest-634185708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.757s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:22 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e6fdb0e2-eba2-4500-b6f2-554477f228f7 tempest-VolumesExtendTest-634185708 None] Extend volume completed successfully. Apr 24 19:25:22 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de" returned: 0 in 0.658s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:23 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de Apr 24 19:25:23 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Creating offline snapshot 8fd2257f-997d-4dc4-b865-086a94f1a86a of volume 2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae8d60-faa1-499c-94ff-92b817def24d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:23 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca Apr 24 19:25:23 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:23 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573.0d1ad725-056c-4db9-b4bf-60f93d8313de" returned: 0 in 0.449s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-0d1ad725-056c-4db9-b4bf-60f93d8313de" released by "_delete_snapshot" :: held 2.452s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-d420e2e1-1e49-4edd-a9bb-31c5b9533573" released by "delete_snapshot" :: held 2.479s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Created reservations ['0747de86-bd2a-4ed1-8486-521dfefb946b', '34497d4f-af60-4fec-a7f3-8aec361e1d91', 'de3873b5-0f17-4cc8-9441-e09327e5dc8a', '021f4aaf-e090-4ed5-824d-b84e3a8e0218'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:23 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca" returned: 0 in 0.575s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:23 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Delete snapshot completed successfully. Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-45facd26-38be-4b02-a2ee-74bd101a10fb tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-0d1ad725-056c-4db9-b4bf-60f93d8313de-delete_snapshot" released by "delete_snapshot" :: held 2.657s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:23 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a 1G Apr 24 19:25:23 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Acquiring lock "cinder-7670beec-3371-4f81-9886-def838bcc29e-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Lock "cinder-7670beec-3371-4f81-9886-def838bcc29e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Acquiring lock "cinder-quobyte-089d1bcf-9747-40f3-ab5d-2cf95935c293" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Lock "cinder-quobyte-089d1bcf-9747-40f3-ab5d-2cf95935c293" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Acquiring lock "cinder-quobyte-7670beec-3371-4f81-9886-def838bcc29e" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Lock "cinder-quobyte-7670beec-3371-4f81-9886-def838bcc29e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Deleting offline snapshot 7670beec-3371-4f81-9886-def838bcc29e of volume 089d1bcf-9747-40f3-ab5d-2cf95935c293 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] snapshot_file for this snap is: volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f6eb92-681e-48f0-aef6-3d1b088bdafa]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:24 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e Apr 24 19:25:24 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-d420e2e1-1e49-4edd-a9bb-31c5b9533573-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-d420e2e1-1e49-4edd-a9bb-31c5b9533573-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-d420e2e1-1e49-4edd-a9bb-31c5b9533573" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-d420e2e1-1e49-4edd-a9bb-31c5b9533573" acquired by "delete_volume" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77c78dc-b721-4194-8399-a23b9fca1361]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:24 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a 1G" returned: 0 in 0.774s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb60099-e8d2-4525-9c61-c21f72978bca -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:24 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb60099-e8d2-4525-9c61-c21f72978bca -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a Apr 24 19:25:24 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:24 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 Apr 24 19:25:24 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:24 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e" returned: 0 in 0.662s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-089d1bcf-9747-40f3-ab5d-2cf95935c293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[05010124-739a-4307-828e-bcc7f4f7a884]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:24 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 Apr 24 19:25:24 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:24 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb60099-e8d2-4525-9c61-c21f72978bca -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a" returned: 0 in 0.593s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:24 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a is being set with open permissions: ugo+rw Apr 24 19:25:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:25 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a Apr 24 19:25:25 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:25 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573" returned: 0 in 0.646s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:25 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573 Apr 24 19:25:25 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:25 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293" returned: 0 in 0.520s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:25 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e Apr 24 19:25:25 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:25 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a" returned: 0 in 0.506s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:25 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d420e2e1-1e49-4edd-a9bb-31c5b9533573" returned: 0 in 0.510s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:25 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.info Apr 24 19:25:25 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-d420e2e1-1e49-4edd-a9bb-31c5b9533573" released by "delete_volume" :: held 1.216s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Created reservations ['8392f963-d4b2-4c7d-a4f8-051ada2206a4', '381dacd5-b46b-49d3-a6bd-b5f0ecda94a2', '3bd35f4e-7ce2-4ed1-aab3-23e7fec72755', '847f5450-e516-44df-90eb-4df38f41a142'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:25 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:25 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:25 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e" returned: 0 in 0.710s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:25 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e Apr 24 19:25:25 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:26 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.info" returned: 0 in 0.597s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:26 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.info is being set with open permissions: ugo+rw Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:26 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.info Apr 24 19:25:26 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:26 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.497s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:26 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Deleted volume successfully. Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2a94eb3e-d8a6-4245-90c1-0a6d419093a6 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-d420e2e1-1e49-4edd-a9bb-31c5b9533573-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:26 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293.7670beec-3371-4f81-9886-def838bcc29e" returned: 0 in 0.474s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Lock "cinder-quobyte-7670beec-3371-4f81-9886-def838bcc29e" released by "_delete_snapshot" :: held 2.508s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Lock "cinder-quobyte-089d1bcf-9747-40f3-ab5d-2cf95935c293" released by "delete_snapshot" :: held 2.534s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Created reservations ['5d7a7671-bc45-4b29-8612-f2c3b8a325db', 'cc489022-f1ff-4a63-931e-e66bbc25f25f', '5ba8b702-d3a0-469e-b2eb-9678d1d982ae', '8c934066-65d2-49dc-a10a-19a5d360f5a3'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:26 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Delete snapshot completed successfully. Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cdc0c773-ed4c-4611-ab78-3be60b6b516f tempest-VolumesExtendTest-634185708 None] Lock "cinder-7670beec-3371-4f81-9886-def838bcc29e-delete_snapshot" released by "delete_snapshot" :: held 2.708s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:26 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.info" returned: 0 in 0.519s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.662s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:26 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-43e61004-595d-4884-8605-ba903de4295a tempest-VolumesSnapshotListTestJSON-205729906 None] Create snapshot completed successfully Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Flow 'volume_create_manager' (b0c554fa-3a30-46a3-a5f1-7519a44fdf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86adf69-43e7-4ece-8819-369cdd381d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86adf69-43e7-4ece-8819-369cdd381d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1606552984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10838f8388e243b5980bee0388d3f234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:27Z,use_quota=True,user_id='dcf09b74ffd84458abf0fb6f630e217e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8f4b00-47d2-46fe-8469-2c16c0f23ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8f4b00-47d2-46fe-8469-2c16c0f23ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8449eab5-d776-4a50-a5a7-081719625d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8449eab5-d776-4a50-a5a7-081719625d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24', 'volume_name': 'volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac24e85-b77b-4e8d-9c2d-8217c2cba6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac24e85-b77b-4e8d-9c2d-8217c2cba6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ccff58-411d-4089-932c-ea845b2a3155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:26 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Volume f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24', 'volume_size': 1} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1606552984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10838f8388e243b5980bee0388d3f234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:27Z,use_quota=True,user_id='dcf09b74ffd84458abf0fb6f630e217e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Creating volume f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:26 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:25:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:27 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 1073741824 Apr 24 19:25:27 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Acquiring lock "cinder-089d1bcf-9747-40f3-ab5d-2cf95935c293-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Lock "cinder-089d1bcf-9747-40f3-ab5d-2cf95935c293-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Acquiring lock "cinder-quobyte-089d1bcf-9747-40f3-ab5d-2cf95935c293" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Lock "cinder-quobyte-089d1bcf-9747-40f3-ab5d-2cf95935c293" acquired by "delete_volume" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e5696f-1f17-4b34-b1d9-62e4725ec642]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:27 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 Apr 24 19:25:27 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:27 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 1073741824" returned: 0 in 0.760s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:27 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293" returned: 0 in 0.613s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:27 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293 Apr 24 19:25:27 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:28 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 Apr 24 19:25:28 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:28 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-089d1bcf-9747-40f3-ab5d-2cf95935c293" returned: 0 in 0.479s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Lock "cinder-quobyte-089d1bcf-9747-40f3-ab5d-2cf95935c293" released by "delete_volume" :: held 1.173s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Created reservations ['d2961f62-9a1e-4e62-bc08-2831f62743ed', 'd990694a-50bf-4371-838e-5e96db652ae1', 'cc708683-b0f0-434d-8efb-8f8386ab7446', '56d8d55a-81b5-473a-8264-f2525d68e1fb'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:28 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" returned: 0 in 0.555s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.143s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:28 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:28 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] Creating offline snapshot e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 of volume 2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ccff58-411d-4089-932c-ea845b2a3155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6639037b-2a29-4602-8fde-82177f8e0621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[056df7ab-adfe-4ac0-9477-7bc8ca40ffd4]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:28 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Volume volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 (f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24): created successfully Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6639037b-2a29-4602-8fde-82177f8e0621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Flow 'volume_create_manager' (b0c554fa-3a30-46a3-a5f1-7519a44fdf5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9b92f0fb-894c-4bae-b177-a05879c8e54c tempest-VolumesSnapshotTestJSON-102735968 None] Created volume successfully. Apr 24 19:25:28 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a Apr 24 19:25:28 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:29 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.522s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:29 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:29 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Deleted volume successfully. Apr 24 19:25:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-49ccca9e-1eaa-429c-9544-26e4b1f4733c tempest-VolumesExtendTest-634185708 None] Lock "cinder-089d1bcf-9747-40f3-ab5d-2cf95935c293-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:29 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a" returned: 0 in 0.681s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bb60099-e8d2-4525-9c61-c21f72978bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:29 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 1G Apr 24 19:25:29 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:30 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 1G" returned: 0 in 0.696s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:30 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 Apr 24 19:25:30 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:30 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2" returned: 0 in 0.709s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:30 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 is being set with open permissions: ugo+rw Apr 24 19:25:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:30 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 Apr 24 19:25:30 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:31 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2" returned: 0 in 0.603s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.827s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.162s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Creating offline snapshot 78548b45-00f1-45fa-849b-a101ecbb01d0 of volume f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:31 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-29f80fc0-182c-46d2-9f89-f24f72577233 tempest-VolumesSnapshotListTestJSON-205729906 None] Create snapshot completed successfully Apr 24 19:25:31 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f5044c-d478-4059-bf41-a1dc58deba98]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:31 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 Apr 24 19:25:31 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:32 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" returned: 0 in 0.630s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:32 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 1G Apr 24 19:25:32 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (b926325a-6889-4c46-9e2f-73e1ea8a1c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f766f26e-75e6-457b-a7f9-9e577a21384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f766f26e-75e6-457b-a7f9-9e577a21384b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2119295313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f958a8f1-0dda-4f98-b42c-c02bae456b21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:32Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d80802-a044-4cac-8618-b986c64deead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d80802-a044-4cac-8618-b986c64deead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df02fe0a-423f-41d2-b9ad-10d1863067d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df02fe0a-423f-41d2-b9ad-10d1863067d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f958a8f1-0dda-4f98-b42c-c02bae456b21', 'volume_name': 'volume-f958a8f1-0dda-4f98-b42c-c02bae456b21', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe75c4e2-78b9-462b-8b0f-60d3dce653e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe75c4e2-78b9-462b-8b0f-60d3dce653e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815f24e2-7719-4217-929e-753bcdab7af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:32 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Volume f958a8f1-0dda-4f98-b42c-c02bae456b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f958a8f1-0dda-4f98-b42c-c02bae456b21', 'volume_size': 1} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:32 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 1G" returned: 0 in 0.750s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:32 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 Apr 24 19:25:32 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:33 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0" returned: 0 in 0.538s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:33 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 is being set with open permissions: ugo+rw Apr 24 19:25:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:33 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 Apr 24 19:25:33 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:33 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0" returned: 0 in 0.447s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:33 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.info Apr 24 19:25:33 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:34 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.info" returned: 0 in 0.472s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:34 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.info is being set with open permissions: ugo+rw Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:34 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.info Apr 24 19:25:34 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:34 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.info" returned: 0 in 0.440s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.450s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.519s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2119295313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f958a8f1-0dda-4f98-b42c-c02bae456b21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:32Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Creating volume f958a8f1-0dda-4f98-b42c-c02bae456b21 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:34 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:25:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:34 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21 1073741824 Apr 24 19:25:34 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:34 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c690d90d-73dc-4c64-8f35-90024a063726 tempest-VolumesSnapshotTestJSON-102735968 None] Create snapshot completed successfully Apr 24 19:25:35 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21 1073741824" returned: 0 in 0.681s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:35 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21 Apr 24 19:25:35 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:35 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Flow 'volume_create_manager' (93795f95-aaca-4fe6-b4f4-c9f634e94a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccaaeb5-ea76-42f0-879b-382fc110cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccaaeb5-ea76-42f0-879b-382fc110cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1442920646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1c55c9-1390-440e-9896-97fac42c606d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10838f8388e243b5980bee0388d3f234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78548b45-00f1-45fa-849b-a101ecbb01d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:36Z,use_quota=True,user_id='dcf09b74ffd84458abf0fb6f630e217e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e54077f-551c-4ea7-bae7-ac97e5e710a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e54077f-551c-4ea7-bae7-ac97e5e710a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa03486-88d4-4642-9056-37b97c629be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa03486-88d4-4642-9056-37b97c629be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f1c55c9-1390-440e-9896-97fac42c606d', 'volume_name': 'volume-7f1c55c9-1390-440e-9896-97fac42c606d', 'volume_size': 1, 'snapshot_id': '78548b45-00f1-45fa-849b-a101ecbb01d0'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7253f59-aab8-4df4-96a6-97ac156d4f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7253f59-aab8-4df4-96a6-97ac156d4f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430008af-2f80-408e-a77c-9bf735917b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:36 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Volume 7f1c55c9-1390-440e-9896-97fac42c606d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f1c55c9-1390-440e-9896-97fac42c606d', 'volume_size': 1, 'snapshot_id': '78548b45-00f1-45fa-849b-a101ecbb01d0'} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:36 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21" returned: 0 in 0.573s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.338s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815f24e2-7719-4217-929e-753bcdab7af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f958a8f1-0dda-4f98-b42c-c02bae456b21', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe89774-8d50-42eb-9b23-22b64c9904d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] Creating offline snapshot ff2a68aa-4036-4b44-8c89-69b89c49702a of volume 2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:36 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Volume volume-f958a8f1-0dda-4f98-b42c-c02bae456b21 (f958a8f1-0dda-4f98-b42c-c02bae456b21): created successfully Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe89774-8d50-42eb-9b23-22b64c9904d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (b926325a-6889-4c46-9e2f-73e1ea8a1c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5794c4e-ba94-4fec-8b4a-49a59f41c4e8]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:36 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-0baa747c-7a14-4e08-8aed-2bb96db1066c tempest-VolumesGetTest-705884640 None] Created volume successfully. Apr 24 19:25:36 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 Apr 24 19:25:36 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:36 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2" returned: 0 in 0.635s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bb60099-e8d2-4525-9c61-c21f72978bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:36 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a 1G Apr 24 19:25:36 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=126,cinder:UPDATE=143,cinder:INSERT=40,cinder:DELETE=11 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (a3145046-8417-4864-995e-228659c59578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c0c945-f02f-4195-a029-466cb41898db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c0c945-f02f-4195-a029-466cb41898db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-904112489',display_name='tempest-VolumesGetTest-Volume-1924001141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00ac6de-7947-4f4b-a7bc-270db04687a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:37Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123cd957-b7b0-4581-8771-c14887535d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123cd957-b7b0-4581-8771-c14887535d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f509ce6-42ee-4428-8ada-126312f258ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f509ce6-42ee-4428-8ada-126312f258ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00ac6de-7947-4f4b-a7bc-270db04687a7', 'volume_name': 'volume-d00ac6de-7947-4f4b-a7bc-270db04687a7', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04525456-6c6a-492b-8036-c710babd7cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04525456-6c6a-492b-8036-c710babd7cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c484f398-aedc-4606-9477-dbef041d65a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:37 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Volume d00ac6de-7947-4f4b-a7bc-270db04687a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00ac6de-7947-4f4b-a7bc-270db04687a7', 'volume_size': 1} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:37 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a 1G" returned: 0 in 0.750s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:37 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a Apr 24 19:25:37 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:38 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a" returned: 0 in 0.541s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:38 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a is being set with open permissions: ugo+rw Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:38 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a Apr 24 19:25:38 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:38 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a" returned: 0 in 0.483s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.627s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-78548b45-00f1-45fa-849b-a101ecbb01d0-7f1c55c9-1390-440e-9896-97fac42c606d" by "_create_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-78548b45-00f1-45fa-849b-a101ecbb01d0-7f1c55c9-1390-440e-9896-97fac42c606d" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Creating volume 7f1c55c9-1390-440e-9896-97fac42c606d from snapshot 78548b45-00f1-45fa-849b-a101ecbb01d0 {{(pid=81943) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-7f1c55c9-1390-440e-9896-97fac42c606d" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:38 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-25a06c25-ac51-4ca3-bad0-8bd2668637e8 tempest-VolumesSnapshotListTestJSON-205729906 None] Create snapshot completed successfully Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-7f1c55c9-1390-440e-9896-97fac42c606d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] snapshot: 78548b45-00f1-45fa-849b-a101ecbb01d0, volume: 7f1c55c9-1390-440e-9896-97fac42c606d, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[acedc558-6502-4124-85b3-421d8f2c22d6]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:38 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 Apr 24 19:25:38 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:39 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0" returned: 0 in 0.687s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:25:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:25:39 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b3e2ab-78ba-4eff-99cd-67aa27ef8fd1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:39 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 Apr 24 19:25:39 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-ff2a68aa-4036-4b44-8c89-69b89c49702a-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-ff2a68aa-4036-4b44-8c89-69b89c49702a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:40 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" returned: 0 in 0.581s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-quobyte-ff2a68aa-4036-4b44-8c89-69b89c49702a" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:40 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d Apr 24 19:25:40 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-ff2a68aa-4036-4b44-8c89-69b89c49702a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Deleting offline snapshot ff2a68aa-4036-4b44-8c89-69b89c49702a of volume 2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] snapshot_file for this snap is: volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b187470f-22c0-4e9a-a2f2-3447e5afecae]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:40 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a Apr 24 19:25:40 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:40 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a" returned: 0 in 0.616s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bb60099-e8d2-4525-9c61-c21f72978bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a695519-bb76-4078-b896-7a500acf44c1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:41 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:41 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:41 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 Apr 24 19:25:41 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:42 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.136s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:42 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2" returned: 0 in 1.853s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bb60099-e8d2-4525-9c61-c21f72978bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:42 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a Apr 24 19:25:42 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:44 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a" returned: 0 in 1.473s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:44 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a Apr 24 19:25:44 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:44 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.ff2a68aa-4036-4b44-8c89-69b89c49702a" returned: 0 in 0.768s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-ff2a68aa-4036-4b44-8c89-69b89c49702a" released by "_delete_snapshot" :: held 4.874s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" released by "delete_snapshot" :: held 4.909s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Created reservations ['353ac4d0-7d89-4286-b9e9-86ae32d0b726', 'f517d490-a7ee-4009-9f3e-5ba25c3a77c5', '3e7c52ab-f4bd-4d64-9194-7db692e8eb7e', '3cf8857a-e343-46fc-af52-a70e061b42be'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:45 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Delete snapshot completed successfully. Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e16f6b9a-8763-4c45-86aa-42efe95b5a84 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-ff2a68aa-4036-4b44-8c89-69b89c49702a-delete_snapshot" released by "delete_snapshot" :: held 5.140s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:45 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d" returned: 0 in 5.212s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99921f2-2aee-4aa0-a6ec-c73356f0c507]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:45 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 Apr 24 19:25:45 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-quobyte-e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Deleting offline snapshot e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 of volume 2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] snapshot_file for this snap is: volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a99c68-8057-4ea6-ab51-998df1d2cf13]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:45 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 Apr 24 19:25:45 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:46 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" returned: 0 in 0.725s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:25:46 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Converted 1024.00 MB image at 196.43 MB/s Apr 24 19:25:46 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d is being set with open permissions: ugo+rw Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:46 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d Apr 24 19:25:46 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:46 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2" returned: 0 in 0.576s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bb60099-e8d2-4525-9c61-c21f72978bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd78df9-ff69-4a38-b7f4-61e4a6bce278]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:46 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a Apr 24 19:25:46 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:46 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d" returned: 0 in 0.488s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-7f1c55c9-1390-440e-9896-97fac42c606d" released by "_copy_volume_from_snapshot" :: held 7.791s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-78548b45-00f1-45fa-849b-a101ecbb01d0-7f1c55c9-1390-440e-9896-97fac42c606d" released by "_create_volume_from_snapshot" :: held 7.833s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.862s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.316s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-904112489',display_name='tempest-VolumesGetTest-Volume-1924001141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00ac6de-7947-4f4b-a7bc-270db04687a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:37Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Creating volume d00ac6de-7947-4f4b-a7bc-270db04687a7 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:46 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:46 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7 1073741824 Apr 24 19:25:46 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430008af-2f80-408e-a77c-9bf735917b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1c55c9-1390-440e-9896-97fac42c606d', 'volume_size': 1, 'snapshot_id': '78548b45-00f1-45fa-849b-a101ecbb01d0'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe7c948-5285-47e4-a277-f14ca85ad571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:46 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Volume volume-7f1c55c9-1390-440e-9896-97fac42c606d (7f1c55c9-1390-440e-9896-97fac42c606d): created successfully Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe7c948-5285-47e4-a277-f14ca85ad571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Flow 'volume_create_manager' (93795f95-aaca-4fe6-b4f4-c9f634e94a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:46 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-db7a9d93-a986-42cf-9da0-035c69ca2a49 tempest-VolumesSnapshotTestJSON-102735968 None] Created volume successfully. Apr 24 19:25:46 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a" returned: 0 in 0.602s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bb60099-e8d2-4525-9c61-c21f72978bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:46 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 Apr 24 19:25:46 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-7f1c55c9-1390-440e-9896-97fac42c606d-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-7f1c55c9-1390-440e-9896-97fac42c606d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-7f1c55c9-1390-440e-9896-97fac42c606d" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-7f1c55c9-1390-440e-9896-97fac42c606d" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae40e29b-cb14-47eb-bcea-068cb60f21a4]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:47 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d Apr 24 19:25:47 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:47 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7 1073741824" returned: 0 in 0.776s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:47 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7 Apr 24 19:25:47 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:47 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2" returned: 0 in 0.713s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:47 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2 Apr 24 19:25:47 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:47 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d" returned: 0 in 0.625s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:47 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d Apr 24 19:25:47 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:47 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7" returned: 0 in 0.522s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c484f398-aedc-4606-9477-dbef041d65a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00ac6de-7947-4f4b-a7bc-270db04687a7', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8413a67a-524c-4208-a923-f454b358c772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:47 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2" returned: 0 in 0.499s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:47 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Volume volume-d00ac6de-7947-4f4b-a7bc-270db04687a7 (d00ac6de-7947-4f4b-a7bc-270db04687a7): created successfully Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8413a67a-524c-4208-a923-f454b358c772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (a3145046-8417-4864-995e-228659c59578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:48 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-fac46cd7-c192-4033-9a23-c290d5e8bcb4 tempest-VolumesGetTest-705884640 None] Created volume successfully. Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2" released by "_delete_snapshot" :: held 2.517s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" released by "delete_snapshot" :: held 2.549s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Created reservations ['b8fef750-bd13-4433-a045-b9ec0f0360ae', 'f8084c36-b3d3-42f2-892a-a8dcdf69bef7', '1f36512d-20d5-4855-b6ff-2e4fd269cd50', 'd870dd9a-493b-40ec-b47d-ab3788dacb83'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:48 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Delete snapshot completed successfully. Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4e206b14-9a78-4bf7-90f4-1400f6f804ad tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-e44f3a5f-b79e-45bb-8a5d-d0d44a8328d2-delete_snapshot" released by "delete_snapshot" :: held 2.744s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:48 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-7f1c55c9-1390-440e-9896-97fac42c606d" returned: 0 in 0.538s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-7f1c55c9-1390-440e-9896-97fac42c606d" released by "delete_volume" :: held 1.211s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-d00ac6de-7947-4f4b-a7bc-270db04687a7-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Created reservations ['f13ac304-c085-4af9-9836-03b53e6cc0eb', '3036fe95-70db-4b64-82f9-70e0bf8db9b0', 'a8fdf9d9-4a4f-4733-a2dd-3f56f1018bfd', '12b9a9d9-a4d3-4038-8678-c46af7df225e'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Lock "cinder-d00ac6de-7947-4f4b-a7bc-270db04687a7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-quobyte-d00ac6de-7947-4f4b-a7bc-270db04687a7" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-d00ac6de-7947-4f4b-a7bc-270db04687a7" acquired by "delete_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[570ad0b4-d80b-45e6-bc6d-26f2eed003e1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:48 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:48 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:48 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7 Apr 24 19:25:48 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-8fd2257f-997d-4dc4-b865-086a94f1a86a-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-8fd2257f-997d-4dc4-b865-086a94f1a86a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-quobyte-8fd2257f-997d-4dc4-b865-086a94f1a86a" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-8fd2257f-997d-4dc4-b865-086a94f1a86a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Deleting offline snapshot 8fd2257f-997d-4dc4-b865-086a94f1a86a of volume 2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] snapshot_file for this snap is: volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[2636f11e-a7fb-49c8-b8fe-4f2e501a17d2]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:48 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a Apr 24 19:25:48 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:49 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.591s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Deleted volume successfully. Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37288ee1-e1bb-4c75-9705-d442279a74e8 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-7f1c55c9-1390-440e-9896-97fac42c606d-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:49 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7" returned: 0 in 0.636s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:49 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7 Apr 24 19:25:49 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-78548b45-00f1-45fa-849b-a101ecbb01d0-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-78548b45-00f1-45fa-849b-a101ecbb01d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-78548b45-00f1-45fa-849b-a101ecbb01d0" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-78548b45-00f1-45fa-849b-a101ecbb01d0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Deleting offline snapshot 78548b45-00f1-45fa-849b-a101ecbb01d0 of volume f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] snapshot_file for this snap is: volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:25:49 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6705dd89-80c6-4a48-a949-3a360bab4dde]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a" returned: 0 in 0.653s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bb60099-e8d2-4525-9c61-c21f72978bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[83513535-fc1b-473b-9ef6-e08470350e11]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:49 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 Apr 24 19:25:49 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:49 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca Apr 24 19:25:49 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:49 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d00ac6de-7947-4f4b-a7bc-270db04687a7" returned: 0 in 0.569s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-d00ac6de-7947-4f4b-a7bc-270db04687a7" released by "delete_volume" :: held 1.269s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=158,cinder:SELECT=151,cinder:INSERT=47,cinder:DELETE=15 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Created reservations ['927ddd4a-490c-4d2f-8f8c-d31705fc1151', 'f2bd9cc6-4d66-4456-8155-e9e7607bbe1e', '1a02394c-faef-4b8e-b548-a55795d27a7c', '62076247-c26e-4e96-b097-197d63b4c4f8'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:49 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:49 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:50 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0" returned: 0 in 0.615s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:50 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca" returned: 0 in 0.588s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda81f85-6cb0-4f60-a2d7-3c775136fe9e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:50 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a Apr 24 19:25:50 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:50 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 Apr 24 19:25:50 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:50 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.491s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:50 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Deleted volume successfully. Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d1083da8-0570-4c06-b2c2-f62003968600 tempest-VolumesGetTest-705884640 None] Lock "cinder-d00ac6de-7947-4f4b-a7bc-270db04687a7-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-f958a8f1-0dda-4f98-b42c-c02bae456b21-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Lock "cinder-f958a8f1-0dda-4f98-b42c-c02bae456b21-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:50 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" returned: 0 in 0.600s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:50 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 Apr 24 19:25:50 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:50 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-quobyte-f958a8f1-0dda-4f98-b42c-c02bae456b21" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a" returned: 0 in 0.659s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-f958a8f1-0dda-4f98-b42c-c02bae456b21" acquired by "delete_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:50 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a Apr 24 19:25:50 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce362d81-5fe5-4a19-b847-c07ecf213a62]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:50 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21 Apr 24 19:25:50 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:51 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca.8fd2257f-997d-4dc4-b865-086a94f1a86a" returned: 0 in 0.499s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-8fd2257f-997d-4dc4-b865-086a94f1a86a" released by "_delete_snapshot" :: held 2.529s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" released by "delete_snapshot" :: held 2.565s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:51 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0" returned: 0 in 0.613s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:51 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0 Apr 24 19:25:51 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Created reservations ['a128e02c-44ba-4423-be55-897a8a339cea', '68b14ac7-189f-4ef7-afe3-d544d6b5b7c3', '07b21d87-b7e9-43fe-addf-9c28327d3186', '8b77e5d3-c982-495b-92f2-f44c252e27a6'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:51 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21" returned: 0 in 0.599s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:51 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21 Apr 24 19:25:51 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:51 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Delete snapshot completed successfully. Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-852647fe-2be7-427a-8abc-a45839e4622d tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-8fd2257f-997d-4dc4-b865-086a94f1a86a-delete_snapshot" released by "delete_snapshot" :: held 2.782s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:51 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24.78548b45-00f1-45fa-849b-a101ecbb01d0" returned: 0 in 0.517s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-78548b45-00f1-45fa-849b-a101ecbb01d0" released by "_delete_snapshot" :: held 2.446s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" released by "delete_snapshot" :: held 2.482s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:51 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f958a8f1-0dda-4f98-b42c-c02bae456b21" returned: 0 in 0.524s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-f958a8f1-0dda-4f98-b42c-c02bae456b21" released by "delete_volume" :: held 1.168s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:51 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Created reservations ['3acd8d88-1c3c-43ba-a585-24d168f2be08', 'af24410c-2be3-499e-a1eb-e3f6c8d0c7b9', '8f277155-4836-4ca9-92df-547d1879304d', '54881cc9-e103-48f5-ae1e-43ac8b34013a'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Created reservations ['cdce1282-95c8-4500-b94e-acaab77e9596', 'af00c312-81e5-40b2-981c-dd08b1c29d0d', 'd20ea494-9224-40ff-80fd-3e75256667f3', '1e3157db-4b3c-46cb-8b7d-1f4cd8a42722'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-2bb60099-e8d2-4525-9c61-c21f72978bca-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Delete snapshot completed successfully. Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-2bb60099-e8d2-4525-9c61-c21f72978bca-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-176ef093-9306-45aa-a4ab-49ba5788f82d tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-78548b45-00f1-45fa-849b-a101ecbb01d0-delete_snapshot" released by "delete_snapshot" :: held 2.726s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" acquired by "delete_volume" :: waited 0.034s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:52 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:52 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[4659abe1-876a-4af9-8c8a-cd87b90b8594]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:52 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca Apr 24 19:25:52 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:52 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.567s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Deleted volume successfully. Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c11ba420-743d-4553-b283-80da61e8ee51 tempest-VolumesGetTest-705884640 None] Lock "cinder-f958a8f1-0dda-4f98-b42c-c02bae456b21-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28ddab2-b6f0-41bc-9f81-cff76bb97c00]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:52 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 Apr 24 19:25:52 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:52 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca" returned: 0 in 0.657s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:52 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca Apr 24 19:25:52 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:53 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" returned: 0 in 0.574s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:53 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24 Apr 24 19:25:53 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:53 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2bb60099-e8d2-4525-9c61-c21f72978bca" returned: 0 in 0.534s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-quobyte-2bb60099-e8d2-4525-9c61-c21f72978bca" released by "delete_volume" :: held 1.253s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:53 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" returned: 0 in 0.486s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24" released by "delete_volume" :: held 1.125s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:53 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Created reservations ['7cb18a55-9936-440d-a5ad-45855118b0b2', '5c1cdea4-24dc-457e-89f2-e36780877862', 'd2a68e80-3782-496d-a63f-b6b7b7f47647', '8925946b-124e-475c-9dd3-513ccdde7532'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:55 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Created reservations ['927af472-77db-46ae-a7fb-0ed6efd957a6', 'ecc881f9-638d-4aee-9c18-1eabb8d69732', '21cd3f0c-adf0-4aa4-b662-8a039acbf800', 'dfe59781-e161-4826-9ebf-5d946a6bc630'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (8211dc1e-2b60-44d6-9137-70ad23e24764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba9fcc8-fac4-4503-b424-a9817a4af6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:56 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:56 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba9fcc8-fac4-4503-b424-a9817a4af6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-220279448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b67b13-caa4-434b-a930-148982433d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:54Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f71e60-9c7b-4771-a02b-e57c4bca0812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f71e60-9c7b-4771-a02b-e57c4bca0812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2f0b29-074e-4d48-9670-b6bcd969c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2f0b29-074e-4d48-9670-b6bcd969c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b67b13-caa4-434b-a930-148982433d46', 'volume_name': 'volume-b1b67b13-caa4-434b-a930-148982433d46', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c001db-770c-448d-a536-fbeda0013cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c001db-770c-448d-a536-fbeda0013cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3705e87-f5bb-420e-bcc5-77bf7ec27c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:56 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Volume b1b67b13-caa4-434b-a930-148982433d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b67b13-caa4-434b-a930-148982433d46', 'volume_size': 1} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-220279448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b67b13-caa4-434b-a930-148982433d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:54Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Creating volume b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:56 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:25:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:56 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 1073741824 Apr 24 19:25:56 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:57 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.506s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:57 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:57 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Deleted volume successfully. Apr 24 19:25:57 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 1073741824" returned: 0 in 0.678s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:57 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:57 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:58 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.417s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:58 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Deleted volume successfully. Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-7b7c5825-0b2c-4235-b504-f5be8aa7a7c0 tempest-VolumesSnapshotListTestJSON-205729906 None] Lock "cinder-2bb60099-e8d2-4525-9c61-c21f72978bca-delete_volume" released by "delete_volume" :: held 5.957s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-ce1d8aab-9e05-49da-9564-6d04db7d0393-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:58 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 Apr 24 19:25:58 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ec071b3a-5d51-4b6e-bf13-2a85faeb4ecd tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-f50ad036-5f4d-4c87-8a1d-9ea40b8cfa24-delete_volume" released by "delete_volume" :: held 5.591s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-ce1d8aab-9e05-49da-9564-6d04db7d0393-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "cinder-quobyte-ce1d8aab-9e05-49da-9564-6d04db7d0393" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-ce1d8aab-9e05-49da-9564-6d04db7d0393" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf4b9de-90ba-4a54-a033-ea7221e666d1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:58 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 Apr 24 19:25:58 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:58 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46" returned: 0 in 0.645s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3705e87-f5bb-420e-bcc5-77bf7ec27c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b67b13-caa4-434b-a930-148982433d46', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8820630-36ac-4675-af36-289b17087a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:58 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Volume volume-b1b67b13-caa4-434b-a930-148982433d46 (b1b67b13-caa4-434b-a930-148982433d46): created successfully Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8820630-36ac-4675-af36-289b17087a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (8211dc1e-2b60-44d6-9137-70ad23e24764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:58 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f9142270-336e-44f0-a0e3-d25dd5183029 tempest-VolumesGetTest-705884640 None] Created volume successfully. Apr 24 19:25:59 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393" returned: 0 in 0.671s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:59 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393 Apr 24 19:25:59 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:59 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ce1d8aab-9e05-49da-9564-6d04db7d0393" returned: 0 in 0.618s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-quobyte-ce1d8aab-9e05-49da-9564-6d04db7d0393" released by "delete_volume" :: held 1.355s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Created reservations ['866c1ff1-6561-4800-9fbe-efd834d19dc4', '97ae4327-0ae4-4a42-8a17-4ae097d81886', '1b98e493-8e90-4bf5-8606-29d6358ce4dd', 'ed6c4c27-1729-46a8-b492-a825c74240a2'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:59 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:25:59 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:59 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (9cb0f070-6eb3-44ec-9b37-9f77c174c182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745d3c06-5195-42a1-833b-959891b30b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745d3c06-5195-42a1-833b-959891b30b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-402110285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2516a75e-b041-4e95-8e7c-94eb1a18961d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b1b67b13-caa4-434b-a930-148982433d46,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:00Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e0e7a6-815e-43f0-b486-120f1911a5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e0e7a6-815e-43f0-b486-120f1911a5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d53dc78-96e0-4569-a5b3-aa15e58a6103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d53dc78-96e0-4569-a5b3-aa15e58a6103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2516a75e-b041-4e95-8e7c-94eb1a18961d', 'volume_name': 'volume-2516a75e-b041-4e95-8e7c-94eb1a18961d', 'volume_size': 1, 'source_volid': 'b1b67b13-caa4-434b-a930-148982433d46', 'source_volstatus': 'available'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc95bad1-b4e3-4b0c-8ed2-f7e035766592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc95bad1-b4e3-4b0c-8ed2-f7e035766592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9d1db2-6696-4fa5-92f5-e7316725a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Volume 2516a75e-b041-4e95-8e7c-94eb1a18961d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2516a75e-b041-4e95-8e7c-94eb1a18961d', 'volume_size': 1, 'source_volid': 'b1b67b13-caa4-434b-a930-148982433d46', 'source_volstatus': 'available'} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:00 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Cloning volume b1b67b13-caa4-434b-a930-148982433d46 to volume 2516a75e-b041-4e95-8e7c-94eb1a18961d Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Creating offline snapshot 9a9448f8-74e9-422c-891f-10149dc580e6 of volume b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f8576a-9fd7-404e-9102-e9ebc8205214]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:00 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 Apr 24 19:26:00 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:00 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.580s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:00 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Deleted volume successfully. Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4516475c-0572-420a-8b44-a6ae7051f426 tempest-VolumesSnapshotTestJSON-102735968 None] Lock "cinder-ce1d8aab-9e05-49da-9564-6d04db7d0393-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:00 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46" returned: 0 in 0.685s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:00 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 1G Apr 24 19:26:00 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Flow 'volume_create_manager' (aafafde4-f72f-41b4-a58e-10413276b43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2675625a-eb3a-4d00-b28a-e8e887d4d3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2675625a-eb3a-4d00-b28a-e8e887d4d3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1426525152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdda65ff-1117-4b99-a6b3-31a1da02b766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1914711e3d040a2a8d5fdfb47543578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:01Z,use_quota=True,user_id='c3288001976c43e99c0018815d5ec102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963338cb-0311-47e8-acd3-9cc85580cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963338cb-0311-47e8-acd3-9cc85580cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ae7e5c-304c-425c-b005-ff05f348e1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ae7e5c-304c-425c-b005-ff05f348e1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdda65ff-1117-4b99-a6b3-31a1da02b766', 'volume_name': 'volume-bdda65ff-1117-4b99-a6b3-31a1da02b766', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23be521-d1e8-41ef-bc31-1407a233543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23be521-d1e8-41ef-bc31-1407a233543c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcaaf1b-cd33-4bdf-bc2e-3cd1d439c1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:01 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Volume bdda65ff-1117-4b99-a6b3-31a1da02b766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdda65ff-1117-4b99-a6b3-31a1da02b766', 'volume_size': 1} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:01 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 1G" returned: 0 in 0.785s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b67b13-caa4-434b-a930-148982433d46 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:01 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b67b13-caa4-434b-a930-148982433d46 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 Apr 24 19:26:01 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:02 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b67b13-caa4-434b-a930-148982433d46 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6" returned: 0 in 0.572s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:02 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 is being set with open permissions: ugo+rw Apr 24 19:26:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:02 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 Apr 24 19:26:02 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:02 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6" returned: 0 in 0.471s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:02 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.info Apr 24 19:26:02 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:03 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.info" returned: 0 in 0.522s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:03 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.info is being set with open permissions: ugo+rw Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:03 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.info Apr 24 19:26:03 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:03 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.info" returned: 0 in 0.590s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-quobyte-2516a75e-b041-4e95-8e7c-94eb1a18961d" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-2516a75e-b041-4e95-8e7c-94eb1a18961d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] snapshot: 9a9448f8-74e9-422c-891f-10149dc580e6, volume: 2516a75e-b041-4e95-8e7c-94eb1a18961d, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d1e13e-f664-41dc-ac2d-817eae545dcf]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:03 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 Apr 24 19:26:03 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:04 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6" returned: 0 in 0.667s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b67b13-caa4-434b-a930-148982433d46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:26:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:26:04 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c69e6-e8e6-49cc-a51a-a2bf8644971f]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:04 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 Apr 24 19:26:04 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:05 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46" returned: 0 in 0.631s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:05 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:26:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:05 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d Apr 24 19:26:05 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:10 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d" returned: 0 in 4.924s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:10 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4318ee5-4c36-4036-829e-073fdcd7fb42]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:10 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 Apr 24 19:26:10 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:10 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46" returned: 0 in 0.678s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:10 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:26:10 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Converted 1024.00 MB image at 207.85 MB/s Apr 24 19:26:10 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d is being set with open permissions: ugo+rw Apr 24 19:26:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:10 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d Apr 24 19:26:10 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:11 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d" returned: 0 in 0.450s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-2516a75e-b041-4e95-8e7c-94eb1a18961d" released by "_copy_volume_from_snapshot" :: held 7.458s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-quobyte-9a9448f8-74e9-422c-891f-10149dc580e6" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-9a9448f8-74e9-422c-891f-10149dc580e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Deleting offline snapshot 9a9448f8-74e9-422c-891f-10149dc580e6 of volume b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] snapshot_file for this snap is: volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8870451-4204-45de-8748-c0c46dcdac2d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:11 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 Apr 24 19:26:11 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:11 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6" returned: 0 in 0.593s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b67b13-caa4-434b-a930-148982433d46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[140b7ce7-cc13-4b36-aa27-899c6310fb49]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:11 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:12 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 Apr 24 19:26:12 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:12 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46" returned: 0 in 0.533s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:12 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 Apr 24 19:26:12 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:13 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6" returned: 0 in 0.576s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:13 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6 Apr 24 19:26:13 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:13 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46.9a9448f8-74e9-422c-891f-10149dc580e6" returned: 0 in 0.531s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-9a9448f8-74e9-422c-891f-10149dc580e6" released by "_delete_snapshot" :: held 2.334s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.612s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.604s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1426525152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdda65ff-1117-4b99-a6b3-31a1da02b766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1914711e3d040a2a8d5fdfb47543578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:01Z,use_quota=True,user_id='c3288001976c43e99c0018815d5ec102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Creating volume bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:13 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:13 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 1073741824 Apr 24 19:26:13 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9d1db2-6696-4fa5-92f5-e7316725a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2516a75e-b041-4e95-8e7c-94eb1a18961d', 'volume_size': 1, 'source_volid': 'b1b67b13-caa4-434b-a930-148982433d46', 'source_volstatus': 'available'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf3ffe7-c114-4f84-b396-e3eb67106b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:13 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Volume volume-2516a75e-b041-4e95-8e7c-94eb1a18961d (2516a75e-b041-4e95-8e7c-94eb1a18961d): created successfully Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf3ffe7-c114-4f84-b396-e3eb67106b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (9cb0f070-6eb3-44ec-9b37-9f77c174c182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:13 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-b1030bbe-1101-4fcb-885e-cea4f76d564d tempest-VolumesGetTest-705884640 None] Created volume successfully. Apr 24 19:26:14 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 1073741824" returned: 0 in 0.779s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:14 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 Apr 24 19:26:14 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (01192e89-6983-4d10-b699-d35f84848f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f66cf68-e856-485f-98de-3f5011eedd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f66cf68-e856-485f-98de-3f5011eedd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-423090429',display_name='tempest-VolumesGetTest-Volume-2029920438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0215d54b-0564-42ac-9768-c84485aea112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:15Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2389cdc6-d5b7-45f2-951e-6f2a4230c6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2389cdc6-d5b7-45f2-951e-6f2a4230c6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d58d71-eeaf-4736-abb7-d3c5c6f95e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d58d71-eeaf-4736-abb7-d3c5c6f95e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0215d54b-0564-42ac-9768-c84485aea112', 'volume_name': 'volume-0215d54b-0564-42ac-9768-c84485aea112', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9c4878-827c-4093-b621-11b901218375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9c4878-827c-4093-b621-11b901218375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c154be43-ba2b-4e3a-9406-253a4e52248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:14 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Volume 0215d54b-0564-42ac-9768-c84485aea112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0215d54b-0564-42ac-9768-c84485aea112', 'volume_size': 1} Apr 24 19:26:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:15 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766" returned: 0 in 0.518s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.071s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-423090429',display_name='tempest-VolumesGetTest-Volume-2029920438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0215d54b-0564-42ac-9768-c84485aea112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:15Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Creating volume 0215d54b-0564-42ac-9768-c84485aea112 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:15 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcaaf1b-cd33-4bdf-bc2e-3cd1d439c1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdda65ff-1117-4b99-a6b3-31a1da02b766', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa4cf8b-f001-44a4-b319-2125a30baed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:15 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112 1073741824 Apr 24 19:26:15 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:15 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Volume volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 (bdda65ff-1117-4b99-a6b3-31a1da02b766): created successfully Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa4cf8b-f001-44a4-b319-2125a30baed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Flow 'volume_create_manager' (aafafde4-f72f-41b4-a58e-10413276b43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:15 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c9eeb714-3ee5-457b-b475-81bd6e71879d tempest-VolumeDependencyTests-1224771928 None] Created volume successfully. Apr 24 19:26:15 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112 1073741824" returned: 0 in 0.694s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:15 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112 Apr 24 19:26:15 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:16 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112" returned: 0 in 0.525s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c154be43-ba2b-4e3a-9406-253a4e52248b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0215d54b-0564-42ac-9768-c84485aea112', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db03144-4040-4833-955b-f8b5d2946d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:16 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Volume volume-0215d54b-0564-42ac-9768-c84485aea112 (0215d54b-0564-42ac-9768-c84485aea112): created successfully Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db03144-4040-4833-955b-f8b5d2946d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (01192e89-6983-4d10-b699-d35f84848f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:16 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-a76260dc-acdb-434a-b519-ee7d10f3cadd tempest-VolumesGetTest-705884640 None] Created volume successfully. Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Creating offline snapshot 94ac6c7c-74dd-451d-b6ae-cf89e9ff283c of volume bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[55281a6a-0f13-4805-a40c-bdec9d619e27]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:16 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 Apr 24 19:26:16 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:17 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766" returned: 0 in 0.558s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:17 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c 1G Apr 24 19:26:17 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-0215d54b-0564-42ac-9768-c84485aea112-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Lock "cinder-0215d54b-0564-42ac-9768-c84485aea112-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-quobyte-0215d54b-0564-42ac-9768-c84485aea112" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-0215d54b-0564-42ac-9768-c84485aea112" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a21f97-74c4-4086-a087-5ffc2d45a53b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:17 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112 Apr 24 19:26:17 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:17 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c 1G" returned: 0 in 0.716s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:17 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c Apr 24 19:26:17 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:17 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112" returned: 0 in 0.564s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:17 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112 Apr 24 19:26:17 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:18 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c" returned: 0 in 0.500s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:18 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c is being set with open permissions: ugo+rw Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:18 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c Apr 24 19:26:18 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:18 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0215d54b-0564-42ac-9768-c84485aea112" returned: 0 in 0.493s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-0215d54b-0564-42ac-9768-c84485aea112" released by "delete_volume" :: held 1.098s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Created reservations ['93962e9d-0fb4-46b4-91b3-3cbe189d1c8f', 'ec8364e7-7a04-491d-bac1-7b29998172fe', 'da48e7a9-a8d7-41e3-ad29-bd91e063c7cc', '6aaa053e-3813-4f33-a99a-0c4f9d6dce1b'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:18 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:18 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:18 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c" returned: 0 in 0.517s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:18 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.info Apr 24 19:26:18 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:19 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.475s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:19 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Deleted volume successfully. Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-694aa126-b26a-4d76-8dac-399073eba952 tempest-VolumesGetTest-705884640 None] Lock "cinder-0215d54b-0564-42ac-9768-c84485aea112-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:19 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.info" returned: 0 in 0.489s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:19 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.info is being set with open permissions: ugo+rw Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:19 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.info Apr 24 19:26:19 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-2516a75e-b041-4e95-8e7c-94eb1a18961d-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Lock "cinder-2516a75e-b041-4e95-8e7c-94eb1a18961d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-quobyte-2516a75e-b041-4e95-8e7c-94eb1a18961d" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-2516a75e-b041-4e95-8e7c-94eb1a18961d" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[69552e5f-5c86-4924-bdb2-23ccf913b3c4]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:19 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d Apr 24 19:26:19 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:19 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.info" returned: 0 in 0.479s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.345s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:19 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-6dba8a07-4c0a-431d-b0fd-00731f57483a tempest-VolumeDependencyTests-1224771928 None] Create snapshot completed successfully Apr 24 19:26:20 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d" returned: 0 in 0.561s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:20 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d Apr 24 19:26:20 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:20 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2516a75e-b041-4e95-8e7c-94eb1a18961d" returned: 0 in 0.445s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-2516a75e-b041-4e95-8e7c-94eb1a18961d" released by "delete_volume" :: held 1.057s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Created reservations ['50f219f6-8b8d-425d-9a5f-d607eb0b1ef9', 'de11221b-48e6-4dd5-ac47-61c7e32a46b6', '77d076e0-d7b0-43ce-9517-7df5f6e6a872', '81095bcc-fb63-42bb-bfb5-a52741fefbd1'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:20 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:20 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Flow 'volume_create_manager' (6fdf0d72-4cda-4f0b-921f-b2f797ab8f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8c156a-34ff-44e5-8fda-e01f2f36538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8c156a-34ff-44e5-8fda-e01f2f36538d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1290292429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cd3905-88e6-4e78-b083-d272869b967b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1914711e3d040a2a8d5fdfb47543578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=94ac6c7c-74dd-451d-b6ae-cf89e9ff283c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:21Z,use_quota=True,user_id='c3288001976c43e99c0018815d5ec102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d482ce-7365-4676-94cc-87f08a9c9373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d482ce-7365-4676-94cc-87f08a9c9373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e6e480-0b2e-4947-9450-b9c7db272ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e6e480-0b2e-4947-9450-b9c7db272ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd1cd3905-88e6-4e78-b083-d272869b967b', 'volume_name': 'volume-d1cd3905-88e6-4e78-b083-d272869b967b', 'volume_size': 1, 'snapshot_id': '94ac6c7c-74dd-451d-b6ae-cf89e9ff283c'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71941a2d-8a8a-40ff-9ce8-ac329c1c449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71941a2d-8a8a-40ff-9ce8-ac329c1c449e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:21 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84422b63-c174-413f-a55a-0535b4ba5ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:21 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Volume d1cd3905-88e6-4e78-b083-d272869b967b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d1cd3905-88e6-4e78-b083-d272869b967b', 'volume_size': 1, 'snapshot_id': '94ac6c7c-74dd-451d-b6ae-cf89e9ff283c'} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.465s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:21 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Deleted volume successfully. Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-quobyte-94ac6c7c-74dd-451d-b6ae-cf89e9ff283c-d1cd3905-88e6-4e78-b083-d272869b967b" by "_create_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2f3c8b39-a46b-4bb7-9929-dbc411be2d0a tempest-VolumesGetTest-705884640 None] Lock "cinder-2516a75e-b041-4e95-8e7c-94eb1a18961d-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-94ac6c7c-74dd-451d-b6ae-cf89e9ff283c-d1cd3905-88e6-4e78-b083-d272869b967b" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Creating volume d1cd3905-88e6-4e78-b083-d272869b967b from snapshot 94ac6c7c-74dd-451d-b6ae-cf89e9ff283c {{(pid=81943) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-quobyte-d1cd3905-88e6-4e78-b083-d272869b967b" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-d1cd3905-88e6-4e78-b083-d272869b967b" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] snapshot: 94ac6c7c-74dd-451d-b6ae-cf89e9ff283c, volume: d1cd3905-88e6-4e78-b083-d272869b967b, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dde91aa-51fd-4e9b-ab2c-00a13c2dd2be]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:21 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c Apr 24 19:26:21 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-b1b67b13-caa4-434b-a930-148982433d46-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:21 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Lock "cinder-b1b67b13-caa4-434b-a930-148982433d46-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c" returned: 0 in 0.542s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdda65ff-1117-4b99-a6b3-31a1da02b766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e70a1c-524f-4163-bf8d-e6eddd36ccf4]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-quobyte-b1b67b13-caa4-434b-a930-148982433d46" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-b1b67b13-caa4-434b-a930-148982433d46" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b7d00-4716-43e4-91f2-5ea0f62e458b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:22 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 Apr 24 19:26:22 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:22 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 Apr 24 19:26:22 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:22 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766" returned: 0 in 0.563s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:22 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:26:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:22 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b Apr 24 19:26:22 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:22 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46" returned: 0 in 0.528s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:22 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46 Apr 24 19:26:22 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:22 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b1b67b13-caa4-434b-a930-148982433d46" returned: 0 in 0.466s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-b1b67b13-caa4-434b-a930-148982433d46" released by "delete_volume" :: held 1.047s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:23 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Created reservations ['b8ff9349-0ed2-4f29-86fa-ff9a6b1c60ed', 'cd656f62-4d7e-4875-93e2-d9249f60f1ac', '44ac54c4-935d-4691-a19e-60a8cbad8dc1', 'ba4d539d-5f71-48e3-9968-8f0503209f5d'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:23 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:23 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:24 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.014s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:24 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Deleted volume successfully. Apr 24 19:26:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f450dcb9-d2b4-42be-aabe-619ce11c9fd2 tempest-VolumesGetTest-705884640 None] Lock "cinder-b1b67b13-caa4-434b-a930-148982433d46-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:25 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (03c053f4-3dc9-4ca2-9101-e35ab364efc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2aaad07-4cd2-4837-96fe-220de187e618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2aaad07-4cd2-4837-96fe-220de187e618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1654839685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3b8226-0f03-41d5-9625-d647700ce7e8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:25Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e777ee-4f4a-4494-b8f7-544b141bc8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e777ee-4f4a-4494-b8f7-544b141bc8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1813c8-5487-459d-8b90-9444f495b022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:25 devstack cinder-volume[81943]: DEBUG cinder.image.glance [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Creating Keystone auth plugin from conf {{(pid=81943) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:26:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1813c8-5487-459d-8b90-9444f495b022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef3b8226-0f03-41d5-9625-d647700ce7e8', 'volume_name': 'volume-ef3b8226-0f03-41d5-9625-d647700ce7e8', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93aa7e20-f3f5-4ecf-a97b-9795f61532f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93aa7e20-f3f5-4ecf-a97b-9795f61532f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc21a6e-7390-4086-82de-9f5562c26ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:26 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Volume ef3b8226-0f03-41d5-9625-d647700ce7e8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef3b8226-0f03-41d5-9625-d647700ce7e8', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:26:26 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Trying to clone ef3b8226-0f03-41d5-9625-d647700ce7e8 from image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]). {{(pid=81943) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:26:26 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:26:26 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:26:26 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc65cbf-b1e9-484b-a281-0fa98d2e45bb]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:26 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD Apr 24 19:26:26 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:27 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b" returned: 0 in 5.136s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:27 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4a03a4-eae5-4978-b9d4-0f0b45687a37]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:27 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD" returned: 0 in 1.116s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:27 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Temporary image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 is fetched for user 76f1cc7f2a9947eeafc483038b1d804a. {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:26:27 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 Apr 24 19:26:27 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:27 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c61281-eae7-4e6b-8cf5-31245e5d74e6]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:27 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD Apr 24 19:26:27 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:28 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:28 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766" returned: 0 in 0.636s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:26:28 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Converted 1024.00 MB image at 199.33 MB/s Apr 24 19:26:28 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b is being set with open permissions: ugo+rw Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:28 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b Apr 24 19:26:28 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:28 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b" returned: 0 in 0.479s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-d1cd3905-88e6-4e78-b083-d272869b967b" released by "_copy_volume_from_snapshot" :: held 7.447s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-94ac6c7c-74dd-451d-b6ae-cf89e9ff283c-d1cd3905-88e6-4e78-b083-d272869b967b" released by "_create_volume_from_snapshot" :: held 7.475s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.494s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1654839685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3b8226-0f03-41d5-9625-d647700ce7e8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:25Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Creating volume ef3b8226-0f03-41d5-9625-d647700ce7e8 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:28 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:28 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 1073741824 Apr 24 19:26:28 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84422b63-c174-413f-a55a-0535b4ba5ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1cd3905-88e6-4e78-b083-d272869b967b', 'volume_size': 1, 'snapshot_id': '94ac6c7c-74dd-451d-b6ae-cf89e9ff283c'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0fe6e3-876c-423d-abd8-d8b82fd20702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:28 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Volume volume-d1cd3905-88e6-4e78-b083-d272869b967b (d1cd3905-88e6-4e78-b083-d272869b967b): created successfully Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0fe6e3-876c-423d-abd8-d8b82fd20702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Flow 'volume_create_manager' (6fdf0d72-4cda-4f0b-921f-b2f797ab8f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-287f08c3-7c18-46b8-a516-0a8332628390 tempest-VolumeDependencyTests-1224771928 None] Created volume successfully. Apr 24 19:26:29 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 1073741824" returned: 0 in 0.635s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:29 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 Apr 24 19:26:29 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-94ac6c7c-74dd-451d-b6ae-cf89e9ff283c-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-94ac6c7c-74dd-451d-b6ae-cf89e9ff283c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-quobyte-bdda65ff-1117-4b99-a6b3-31a1da02b766" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-bdda65ff-1117-4b99-a6b3-31a1da02b766" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-quobyte-94ac6c7c-74dd-451d-b6ae-cf89e9ff283c" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-94ac6c7c-74dd-451d-b6ae-cf89e9ff283c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Deleting offline snapshot 94ac6c7c-74dd-451d-b6ae-cf89e9ff283c of volume bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:29 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] snapshot_file for this snap is: volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8" returned: 0 in 0.496s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7340465-116c-4717-9d10-6f19977e0eaa]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:29 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Attempting download of 0ac46f6e-0b50-4bf2-95dd-aa609d212809 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}])) to volume ef3b8226-0f03-41d5-9625-d647700ce7e8. {{(pid=81943) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:26:30 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a438de7-ac3a-4183-b56a-daabdd187eef]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_vfksh92g {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:30 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c Apr 24 19:26:30 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:30 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_vfksh92g Apr 24 19:26:30 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:30 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c" returned: 0 in 0.588s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdda65ff-1117-4b99-a6b3-31a1da02b766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:30 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c16265-a94c-4bf1-a843-f769cc5128e0]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:30 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_vfksh92g" returned: 0 in 0.563s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_vfksh92g {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:30 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 Apr 24 19:26:30 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:30 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_vfksh92g Apr 24 19:26:30 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:31 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_vfksh92g" returned: 1 in 0.499s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ac46f6e-0b50-4bf2-95dd-aa609d212809_vfksh92g' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4e19f6-5a02-4b83-b555-904e4bde560f]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:31 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766" returned: 0 in 0.560s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:31 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c Apr 24 19:26:31 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:31 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD Apr 24 19:26:31 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:31 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] 0ac46f6e-0b50-4bf2-95dd-aa609d212809 was qcow2, converting to raw {{(pid=81943) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:31 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 Apr 24 19:26:31 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:31 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c" returned: 0 in 0.568s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:31 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c Apr 24 19:26:31 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:32 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766.94ac6c7c-74dd-451d-b6ae-cf89e9ff283c" returned: 0 in 0.495s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-94ac6c7c-74dd-451d-b6ae-cf89e9ff283c" released by "_delete_snapshot" :: held 2.314s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-bdda65ff-1117-4b99-a6b3-31a1da02b766" released by "delete_snapshot" :: held 2.341s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:32 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Created reservations ['1ed97a9b-13e7-4c58-a78d-9c0be6434127', '48b04a3c-0136-4763-a332-e283f915c752', 'fe092ac2-4996-4ae4-b47e-dc8eadfa114e', '89d04886-a5ad-464d-8bae-752bb2b8fecb'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:32 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Delete snapshot completed successfully. Apr 24 19:26:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-32ec86bd-7782-4770-b9a2-e016fa4a43f6 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-94ac6c7c-74dd-451d-b6ae-cf89e9ff283c-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:33 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8" returned: 0 in 1.394s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ac46f6e-0b50-4bf2-95dd-aa609d212809_pdkduv_rdevstack@QuobyteHD, size 112.00 MB, duration 1.40 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:26:33 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Converted 112.00 MB image at 80.24 MB/s Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:33 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 1G Apr 24 19:26:33 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-bdda65ff-1117-4b99-a6b3-31a1da02b766-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-bdda65ff-1117-4b99-a6b3-31a1da02b766-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-quobyte-bdda65ff-1117-4b99-a6b3-31a1da02b766" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-bdda65ff-1117-4b99-a6b3-31a1da02b766" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16a5efb-a644-4e3d-af4b-fee22a4378e4]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:33 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 Apr 24 19:26:33 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:33 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 1G" returned: 0 in 0.549s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[9355694e-5d08-415d-91a5-80518c061392]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:33 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 Apr 24 19:26:33 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:33 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766" returned: 0 in 0.556s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:33 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766 Apr 24 19:26:33 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:34 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8" returned: 0 in 0.520s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:34 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bdda65ff-1117-4b99-a6b3-31a1da02b766" returned: 0 in 0.442s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-bdda65ff-1117-4b99-a6b3-31a1da02b766" released by "delete_volume" :: held 1.056s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:34 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 Apr 24 19:26:34 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Created reservations ['b3235cae-7b0e-4e3b-9577-6315351112b9', 'e87a0b78-2df8-41ec-bea3-6da122f3b6a6', 'e37726c4-5b64-4308-b9d6-7251830da3ab', '3fd0140a-7206-49fc-ad40-fe67966a793d'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:34 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:34 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:34 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8" returned: 1 in 0.545s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Downloaded image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}])) to volume ef3b8226-0f03-41d5-9625-d647700ce7e8 successfully. {{(pid=81943) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Temporary image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 for user 76f1cc7f2a9947eeafc483038b1d804a is deleted. {{(pid=81943) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.volume.volume_utils [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Marking volume ef3b8226-0f03-41d5-9625-d647700ce7e8 as bootable. {{(pid=81943) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Copying metadata from image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 to ef3b8226-0f03-41d5-9625-d647700ce7e8. {{(pid=81943) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Creating volume glance metadata for volume ef3b8226-0f03-41d5-9625-d647700ce7e8 backed by image 0ac46f6e-0b50-4bf2-95dd-aa609d212809 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81943) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:26:34 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.464s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc21a6e-7390-4086-82de-9f5562c26ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3b8226-0f03-41d5-9625-d647700ce7e8', 'volume_size': 1, 'image_id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '442d1da37a55425bb64f16f31cfe6309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ac46f6e-0b50-4bf2-95dd-aa609d212809', 'created_at': datetime.datetime(2026, 4, 24, 17, 9, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 9, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ac46f6e-0b50-4bf2-95dd-aa609d212809/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57da355e-11cc-4a05-8641-f0bac76fadb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:34 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Deleted volume successfully. Apr 24 19:26:34 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Volume volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 (ef3b8226-0f03-41d5-9625-d647700ce7e8): created successfully Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57da355e-11cc-4a05-8641-f0bac76fadb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (03c053f4-3dc9-4ca2-9101-e35ab364efc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3a44d665-c003-4399-94f6-01c12a4d294c tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-bdda65ff-1117-4b99-a6b3-31a1da02b766-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:34 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-2e4f3088-0520-47fe-b41a-36ea75a47ccd tempest-VolumesGetTest-705884640 None] Created volume successfully. Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Flow 'volume_create_manager' (4e8afb3b-0a62-4c6b-8630-54896cef1d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eca0050-60b0-495b-b886-8697989adb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eca0050-60b0-495b-b886-8697989adb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1777012687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a808e1-f03b-4898-b68d-60eb53cf8eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1914711e3d040a2a8d5fdfb47543578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:36Z,use_quota=True,user_id='c3288001976c43e99c0018815d5ec102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f413d04e-2289-4b95-8115-d8c4180542e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f413d04e-2289-4b95-8115-d8c4180542e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b770727a-6153-4c46-8759-e76136a14809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b770727a-6153-4c46-8759-e76136a14809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a808e1-f03b-4898-b68d-60eb53cf8eb3', 'volume_name': 'volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a7e1f6-ec50-42c0-bdd3-16acaf2619b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a7e1f6-ec50-42c0-bdd3-16acaf2619b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7859e2-01d4-4592-8b3b-1da584054473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:35 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Volume f4a808e1-f03b-4898-b68d-60eb53cf8eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3', 'volume_size': 1} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1777012687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a808e1-f03b-4898-b68d-60eb53cf8eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1914711e3d040a2a8d5fdfb47543578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:36Z,use_quota=True,user_id='c3288001976c43e99c0018815d5ec102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Creating volume f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:35 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:26:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:35 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 1073741824 Apr 24 19:26:35 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:36 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 1073741824" returned: 0 in 0.745s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:36 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 Apr 24 19:26:36 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (cc153782-5d75-4da0-9105-a77b4474ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71059957-0276-4c01-82d5-acf5bd1d01a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71059957-0276-4c01-82d5-acf5bd1d01a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1504839058',display_name='tempest-VolumesGetTest-Volume-1053310621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6187ea7-03a1-496a-8483-fc7ce0bcc1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:36Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cb9a87-e6c2-4a47-827a-de77e4dc775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cb9a87-e6c2-4a47-827a-de77e4dc775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38ac795-a346-4ab0-b30c-550ccb8207ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38ac795-a346-4ab0-b30c-550ccb8207ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6187ea7-03a1-496a-8483-fc7ce0bcc1bb', 'volume_name': 'volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281e4971-be37-4409-ae5e-b66a0ad4a577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281e4971-be37-4409-ae5e-b66a0ad4a577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bf9d52-7a5f-494b-932e-e36f22114ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:36 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Volume a6187ea7-03a1-496a-8483-fc7ce0bcc1bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb', 'volume_size': 1} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:36 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3" returned: 0 in 0.467s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.345s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1504839058',display_name='tempest-VolumesGetTest-Volume-1053310621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6187ea7-03a1-496a-8483-fc7ce0bcc1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65817a54fbbb42c592c84657437a85c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:36Z,use_quota=True,user_id='76f1cc7f2a9947eeafc483038b1d804a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Creating volume a6187ea7-03a1-496a-8483-fc7ce0bcc1bb {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:36 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7859e2-01d4-4592-8b3b-1da584054473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e163adb9-f6ca-4b33-8e4a-8624a893d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:36 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb 1073741824 Apr 24 19:26:36 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:37 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Volume volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 (f4a808e1-f03b-4898-b68d-60eb53cf8eb3): created successfully Apr 24 19:26:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e163adb9-f6ca-4b33-8e4a-8624a893d48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Flow 'volume_create_manager' (4e8afb3b-0a62-4c6b-8630-54896cef1d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:37 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-bf1a2152-111b-44ab-b0d8-83b0a0d80c62 tempest-VolumeDependencyTests-1224771928 None] Created volume successfully. Apr 24 19:26:37 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb 1073741824" returned: 0 in 0.640s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:37 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=105,cinder:DELETE=14,cinder:INSERT=36,cinder:UPDATE=114 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:26:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:37 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb Apr 24 19:26:37 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:38 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb" returned: 0 in 0.474s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bf9d52-7a5f-494b-932e-e36f22114ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f015b6-19ea-42ea-8063-e31f1e4695f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:38 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Volume volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb (a6187ea7-03a1-496a-8483-fc7ce0bcc1bb): created successfully Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f015b6-19ea-42ea-8063-e31f1e4695f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Flow 'volume_create_manager' (cc153782-5d75-4da0-9105-a77b4474ef66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:38 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-343dd6c1-450f-47c6-a297-0afffc7d61c1 tempest-VolumesGetTest-705884640 None] Created volume successfully. Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Flow 'volume_create_manager' (de35c5d9-83e2-4cef-ad14-239e5b7fcd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4be644-a9ea-481e-88b0-bb8a6c4df792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4be644-a9ea-481e-88b0-bb8a6c4df792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1737871963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1914711e3d040a2a8d5fdfb47543578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f4a808e1-f03b-4898-b68d-60eb53cf8eb3,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:38Z,use_quota=True,user_id='c3288001976c43e99c0018815d5ec102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3f9c92-d12b-40c8-a427-12d74f4fca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3f9c92-d12b-40c8-a427-12d74f4fca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2ede83-3d8b-4046-9a37-e108a2b56fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2ede83-3d8b-4046-9a37-e108a2b56fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3', 'volume_name': 'volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3', 'volume_size': 1, 'source_volid': 'f4a808e1-f03b-4898-b68d-60eb53cf8eb3', 'source_volstatus': 'available'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261dccfa-cb11-4123-a291-9cab7343b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261dccfa-cb11-4123-a291-9cab7343b496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3901bce0-449f-4e2b-85b3-b7106c5dd4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:38 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Volume 8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3', 'volume_size': 1, 'source_volid': 'f4a808e1-f03b-4898-b68d-60eb53cf8eb3', 'source_volstatus': 'available'} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:38 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Cloning volume f4a808e1-f03b-4898-b68d-60eb53cf8eb3 to volume 8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Creating offline snapshot 91bb81c1-b28b-4076-b390-15b70240af1a of volume f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b995e41-d5ac-46b6-abf0-f63ab5c171c9]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:38 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 Apr 24 19:26:38 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Lock "cinder-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-quobyte-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacac7e0-6d4a-45cc-99df-320bea7d928d]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:38 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3" returned: 0 in 0.596s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:38 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb Apr 24 19:26:38 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:38 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a 1G Apr 24 19:26:38 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:39 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb" returned: 0 in 0.533s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:39 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb Apr 24 19:26:39 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:39 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a 1G" returned: 0 in 0.599s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:39 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a Apr 24 19:26:39 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:39 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb" returned: 0 in 0.447s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:39 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb" released by "delete_volume" :: held 1.021s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:39 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Created reservations ['9578fbbd-7b4e-406e-b636-dcc2b8a061af', '6910df98-ac66-4438-a03c-44cef4e12892', 'df34b599-5bbd-41b4-9e7c-c051946f01fb', '03bae5c4-1545-40da-bbec-26b62753b513'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:40 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:40 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:40 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a" returned: 0 in 0.530s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:40 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a is being set with open permissions: ugo+rw Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:40 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a Apr 24 19:26:40 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:40 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.449s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:40 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Deleted volume successfully. Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53782cc1-01dc-49ae-9c01-30eeb053f4fb tempest-VolumesGetTest-705884640 None] Lock "cinder-a6187ea7-03a1-496a-8483-fc7ce0bcc1bb-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:40 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a" returned: 0 in 0.459s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:40 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.info Apr 24 19:26:40 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:40 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:40 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:41 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.info" returned: 0 in 0.477s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:41 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.info is being set with open permissions: ugo+rw Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:41 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.info Apr 24 19:26:41 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-ef3b8226-0f03-41d5-9625-d647700ce7e8-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Lock "cinder-ef3b8226-0f03-41d5-9625-d647700ce7e8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Acquiring lock "cinder-quobyte-ef3b8226-0f03-41d5-9625-d647700ce7e8" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-ef3b8226-0f03-41d5-9625-d647700ce7e8" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd9ff4f-9fe3-407e-8bde-f90bf97898bc]: (4, 'raw') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:41 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 Apr 24 19:26:41 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:41 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.524s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:41 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.info" returned: 0 in 0.533s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-quobyte-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] snapshot: 91bb81c1-b28b-4076-b390-15b70240af1a, volume: 8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efc4be1-501f-4e77-8efd-5e89ded61780]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:41 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a Apr 24 19:26:41 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:41 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8" returned: 0 in 0.541s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:41 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 Apr 24 19:26:41 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:42 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a" returned: 0 in 0.512s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25318ac-552d-4093-b842-7d5995bfa43f]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:42 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 Apr 24 19:26:42 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:42 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8" returned: 1 in 0.507s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8' failed. Not Retrying. {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:42 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8 Apr 24 19:26:42 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:42 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ef3b8226-0f03-41d5-9625-d647700ce7e8" returned: 0 in 0.437s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:42 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3" returned: 0 in 0.527s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Lock "cinder-quobyte-ef3b8226-0f03-41d5-9625-d647700ce7e8" released by "delete_volume" :: held 1.559s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:42 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 Apr 24 19:26:42 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Created reservations ['3125dae3-913a-45a6-82c8-20da309f8e12', '43da51bc-8cec-495a-abff-ffce9c606ee6', '47b6891b-66da-4dbd-bda6-e9ee04f2fe6a', '3832af16-a083-46a8-ba4e-85e40f8b8536'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:42 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:42 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:43 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.585s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:43 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:43 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Deleted volume successfully. Apr 24 19:26:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-944b1cd4-680e-450c-a08f-e8429f37f2a9 tempest-VolumesGetTest-705884640 None] Lock "cinder-ef3b8226-0f03-41d5-9625-d647700ce7e8-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:47 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3" returned: 0 in 4.993s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:47 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87429bc-af4a-45f0-9491-3c4c7241e8b9]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:47 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 Apr 24 19:26:47 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Flow 'volume_create_manager' (10c5d4cb-9ac6-4210-9228-3acbf5a41e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c24bc14-e7ca-48bf-9334-ee4330dbee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:48 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3" returned: 0 in 0.693s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:26:48 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Converted 1024.00 MB image at 205.03 MB/s Apr 24 19:26:48 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 is being set with open permissions: ugo+rw Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c24bc14-e7ca-48bf-9334-ee4330dbee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-894361277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e573ceb8-a536-44f5-bef8-2d4d8ec778c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ae43138d394cc8a9a08ac22dfc9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:48Z,use_quota=True,user_id='bfdf65489fa4466dbd300186742c092d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:48 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 Apr 24 19:26:48 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb7dc02-c4c1-40d7-9b26-c81331ddf2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb7dc02-c4c1-40d7-9b26-c81331ddf2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442579ec-f585-4ac5-92cf-1a8d608d9de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442579ec-f585-4ac5-92cf-1a8d608d9de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e573ceb8-a536-44f5-bef8-2d4d8ec778c6', 'volume_name': 'volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e01224-ba38-4e9b-a293-28579b9805aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e01224-ba38-4e9b-a293-28579b9805aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b6cf0f-c435-4446-b3e5-b26e9b585508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:48 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Volume e573ceb8-a536-44f5-bef8-2d4d8ec778c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6', 'volume_size': 1} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Flow 'volume_create_manager' (c097929d-3915-457e-8824-6b7f89aaf1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803c8bc3-0f71-4c74-8cb3-59cfe2e8ba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803c8bc3-0f71-4c74-8cb3-59cfe2e8ba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1320599844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912fd3e0-e6d6-432d-8ce9-c4f917b9cd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ae43138d394cc8a9a08ac22dfc9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:49Z,use_quota=True,user_id='bfdf65489fa4466dbd300186742c092d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3e08d4-746b-4329-803c-4fadda73e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3e08d4-746b-4329-803c-4fadda73e846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed4bf93-cd43-4192-b141-568015ccc687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed4bf93-cd43-4192-b141-568015ccc687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912fd3e0-e6d6-432d-8ce9-c4f917b9cd14', 'volume_name': 'volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c564a3aa-6492-41e2-992e-5c06c6f63e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c564a3aa-6492-41e2-992e-5c06c6f63e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5985799a-61b5-49f1-863b-c697976b5cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:48 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Volume 912fd3e0-e6d6-432d-8ce9-c4f917b9cd14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14', 'volume_size': 1} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:48 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3" returned: 0 in 0.554s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Flow 'volume_create_manager' (7fb383da-eb1b-4c50-899c-e8359c978ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15e1a69-3662-437a-a29d-27d4d6b633b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3" released by "_copy_volume_from_snapshot" :: held 7.404s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-quobyte-91bb81c1-b28b-4076-b390-15b70240af1a" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15e1a69-3662-437a-a29d-27d4d6b633b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1814435972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9c8536-cfa2-4fd8-9957-6d689e5dc799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ae43138d394cc8a9a08ac22dfc9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:49Z,use_quota=True,user_id='bfdf65489fa4466dbd300186742c092d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecd8077-6471-4cb2-aa05-2a1cae7bf424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecd8077-6471-4cb2-aa05-2a1cae7bf424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee34b3bd-5ccb-41d0-b682-871f1966ed73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee34b3bd-5ccb-41d0-b682-871f1966ed73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe9c8536-cfa2-4fd8-9957-6d689e5dc799', 'volume_name': 'volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf1ea5c-bbe4-403a-8b23-eeb75311ff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf1ea5c-bbe4-403a-8b23-eeb75311ff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29aba8bf-1de2-4e5d-9843-2753a31cb6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Volume fe9c8536-cfa2-4fd8-9957-6d689e5dc799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799', 'volume_size': 1} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-91bb81c1-b28b-4076-b390-15b70240af1a" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Deleting offline snapshot 91bb81c1-b28b-4076-b390-15b70240af1a of volume f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] snapshot_file for this snap is: volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b519e7-ea58-4834-a0ec-f11d2341e9b1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:49 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a Apr 24 19:26:49 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Flow 'volume_create_manager' (9afffcfc-2592-4ca6-9b0f-3fba2ce0658f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595463cb-695e-4bb3-9fb0-0683236bc41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595463cb-695e-4bb3-9fb0-0683236bc41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128134543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669bd1b8-434c-434b-bcb6-3707ccbedfc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ae43138d394cc8a9a08ac22dfc9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:49Z,use_quota=True,user_id='bfdf65489fa4466dbd300186742c092d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1147bf-ba55-4dff-b284-66ad0df9432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1147bf-ba55-4dff-b284-66ad0df9432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817c89ff-806d-4853-ace8-b5e987a95060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817c89ff-806d-4853-ace8-b5e987a95060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669bd1b8-434c-434b-bcb6-3707ccbedfc3', 'volume_name': 'volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d789f6f0-5894-42c9-9c41-8ee495fab8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d789f6f0-5894-42c9-9c41-8ee495fab8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc58b914-b7fc-4d3f-99db-8e2d647cb611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Volume 669bd1b8-434c-434b-bcb6-3707ccbedfc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3', 'volume_size': 1} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Flow 'volume_create_manager' (46e33b3e-c27f-416e-9d02-62db6f4dd277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42cb944-4b08-4fa7-adcf-188e422e40a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42cb944-4b08-4fa7-adcf-188e422e40a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-171600046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01cb4f65-33eb-4afb-aab2-4c3f05d69eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ae43138d394cc8a9a08ac22dfc9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:50Z,use_quota=True,user_id='bfdf65489fa4466dbd300186742c092d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bbf7a4-c22e-4211-9bd9-ccf83d3e009c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bbf7a4-c22e-4211-9bd9-ccf83d3e009c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f3e81c-7ceb-47a3-9750-8b82b24fb634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f3e81c-7ceb-47a3-9750-8b82b24fb634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01cb4f65-33eb-4afb-aab2-4c3f05d69eec', 'volume_name': 'volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b171ca-4ddc-465f-9635-17babcd82890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b171ca-4ddc-465f-9635-17babcd82890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cdfc0b-031e-45d3-ba87-d7e4efbd6b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Volume 01cb4f65-33eb-4afb-aab2-4c3f05d69eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec', 'volume_size': 1} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a" returned: 0 in 0.632s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a7930e-9949-4271-8c4e-4761fee91471]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:49 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 Apr 24 19:26:49 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:50 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3" returned: 0 in 0.545s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:50 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a Apr 24 19:26:50 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:50 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a" returned: 0 in 0.579s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:50 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a Apr 24 19:26:50 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:51 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3.91bb81c1-b28b-4076-b390-15b70240af1a" returned: 0 in 0.477s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-91bb81c1-b28b-4076-b390-15b70240af1a" released by "_delete_snapshot" :: held 2.330s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:INSERT=50,cinder:UPDATE=163,cinder:SELECT=111,cinder:DELETE=7 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.153s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.987s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-894361277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e573ceb8-a536-44f5-bef8-2d4d8ec778c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ae43138d394cc8a9a08ac22dfc9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:48Z,use_quota=True,user_id='bfdf65489fa4466dbd300186742c092d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Creating volume e573ceb8-a536-44f5-bef8-2d4d8ec778c6 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:51 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:51 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6 1073741824 Apr 24 19:26:51 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3901bce0-449f-4e2b-85b3-b7106c5dd4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3', 'volume_size': 1, 'source_volid': 'f4a808e1-f03b-4898-b68d-60eb53cf8eb3', 'source_volstatus': 'available'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fe7f7e-f2f6-4872-bc4a-51da7ecc7f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:51 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Volume volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 (8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3): created successfully Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fe7f7e-f2f6-4872-bc4a-51da7ecc7f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Flow 'volume_create_manager' (de35c5d9-83e2-4cef-ad14-239e5b7fcd86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:51 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-add670af-a7ca-4f69-a070-1e0ef33c5549 tempest-VolumeDependencyTests-1224771928 None] Created volume successfully. Apr 24 19:26:52 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6 1073741824" returned: 0 in 0.622s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:52 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6 Apr 24 19:26:52 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-f4a808e1-f03b-4898-b68d-60eb53cf8eb3-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-f4a808e1-f03b-4898-b68d-60eb53cf8eb3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-quobyte-f4a808e1-f03b-4898-b68d-60eb53cf8eb3" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-f4a808e1-f03b-4898-b68d-60eb53cf8eb3" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb270f-af2e-4ad7-b1c4-a6f1317dd79e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:52 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6" returned: 0 in 0.475s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.825s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1320599844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912fd3e0-e6d6-432d-8ce9-c4f917b9cd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ae43138d394cc8a9a08ac22dfc9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:49Z,use_quota=True,user_id='bfdf65489fa4466dbd300186742c092d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Creating volume 912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:52 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b6cf0f-c435-4446-b3e5-b26e9b585508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:52 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 1073741824 Apr 24 19:26:52 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dadb04-0ffe-44cf-b2e5-bc18012380eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:52 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 Apr 24 19:26:52 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:52 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Volume volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6 (e573ceb8-a536-44f5-bef8-2d4d8ec778c6): created successfully Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dadb04-0ffe-44cf-b2e5-bc18012380eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Flow 'volume_create_manager' (10c5d4cb-9ac6-4210-9228-3acbf5a41e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-fb947c6f-485b-486a-9492-364d2fac4388 tempest-CreateVolumesFromImageTest-1818767821 None] Created volume successfully. Apr 24 19:26:53 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3" returned: 0 in 0.617s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:53 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3 Apr 24 19:26:53 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:53 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 1073741824" returned: 0 in 0.644s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:53 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 Apr 24 19:26:53 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:53 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f4a808e1-f03b-4898-b68d-60eb53cf8eb3" returned: 0 in 0.484s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-f4a808e1-f03b-4898-b68d-60eb53cf8eb3" released by "delete_volume" :: held 1.167s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:53 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14" returned: 0 in 0.453s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.692s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1814435972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9c8536-cfa2-4fd8-9957-6d689e5dc799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ae43138d394cc8a9a08ac22dfc9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:49Z,use_quota=True,user_id='bfdf65489fa4466dbd300186742c092d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Creating volume fe9c8536-cfa2-4fd8-9957-6d689e5dc799 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:53 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Created reservations ['19d2c620-bf3b-4e01-bfce-fd0e22adda0d', 'ded441ed-0ab4-4f44-922c-d401323c5dac', 'afb0d8f1-e60b-492b-aca3-996868a91102', '5c428765-e293-45d3-9012-3059ba941f15'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:53 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799 1073741824 Apr 24 19:26:53 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5985799a-61b5-49f1-863b-c697976b5cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ea2920-43f8-4214-9a7c-380f04009b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:53 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Volume volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 (912fd3e0-e6d6-432d-8ce9-c4f917b9cd14): created successfully Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ea2920-43f8-4214-9a7c-380f04009b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Flow 'volume_create_manager' (c097929d-3915-457e-8824-6b7f89aaf1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:53 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3ea22b28-2ff0-47f3-a3f5-36c23205127a tempest-CreateVolumesFromImageTest-1818767821 None] Created volume successfully. Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:53 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:53 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:54 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.483s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:54 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Deleted volume successfully. Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5763210c-f237-4f91-9566-edc22968f402 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-f4a808e1-f03b-4898-b68d-60eb53cf8eb3-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:54 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799 1073741824" returned: 0 in 0.725s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:54 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799 Apr 24 19:26:54 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-quobyte-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3" acquired by "delete_volume" :: waited 0.014s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8aee67-f397-42e7-a080-165350cf5a83]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:54 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 Apr 24 19:26:54 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:55 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799" returned: 0 in 0.487s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.585s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128134543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669bd1b8-434c-434b-bcb6-3707ccbedfc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ae43138d394cc8a9a08ac22dfc9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:49Z,use_quota=True,user_id='bfdf65489fa4466dbd300186742c092d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Creating volume 669bd1b8-434c-434b-bcb6-3707ccbedfc3 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:55 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29aba8bf-1de2-4e5d-9843-2753a31cb6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:55 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3 1073741824 Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c16ff5-b740-4d4b-9ea0-f3b034609072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:55 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:55 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Volume volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799 (fe9c8536-cfa2-4fd8-9957-6d689e5dc799): created successfully Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c16ff5-b740-4d4b-9ea0-f3b034609072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Flow 'volume_create_manager' (7fb383da-eb1b-4c50-899c-e8359c978ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:55 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5f237e81-6dd4-420b-a68e-7c1bdaf60c1f tempest-CreateVolumesFromImageTest-1818767821 None] Created volume successfully. Apr 24 19:26:55 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3" returned: 0 in 0.598s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:55 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3 Apr 24 19:26:55 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:55 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3 1073741824" returned: 0 in 0.674s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:55 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3 Apr 24 19:26:55 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:55 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3" returned: 0 in 0.504s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3" released by "delete_volume" :: held 1.145s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:55 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Created reservations ['3c16c38b-e70e-4743-a8e8-c0df539307d8', '1dc66e72-18eb-48ce-a973-65179d858387', 'dba40d0c-fa77-427b-acaa-0a2df7c2f115', '671cb7b9-0739-45f2-9653-4f08bf44e1ad'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:56 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:56 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:56 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3" returned: 0 in 0.479s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.479s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-171600046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01cb4f65-33eb-4afb-aab2-4c3f05d69eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ae43138d394cc8a9a08ac22dfc9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:50Z,use_quota=True,user_id='bfdf65489fa4466dbd300186742c092d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Creating volume 01cb4f65-33eb-4afb-aab2-4c3f05d69eec {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:56 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc58b914-b7fc-4d3f-99db-8e2d647cb611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6490bbb5-1dd3-4c68-abc0-1d2a1edcee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:56 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec 1073741824 Apr 24 19:26:56 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:56 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Volume volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3 (669bd1b8-434c-434b-bcb6-3707ccbedfc3): created successfully Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6490bbb5-1dd3-4c68-abc0-1d2a1edcee74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Flow 'volume_create_manager' (9afffcfc-2592-4ca6-9b0f-3fba2ce0658f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-7ddf6281-e47c-4401-82e5-d4f579acc209 tempest-CreateVolumesFromImageTest-1818767821 None] Created volume successfully. Apr 24 19:26:56 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.515s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:56 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Deleted volume successfully. Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-84504551-c5d4-4397-9b1d-45a11b7d8961 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-8c2237e7-0cc2-4579-a7cb-8b1d0717d1c3-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-d1cd3905-88e6-4e78-b083-d272869b967b-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-d1cd3905-88e6-4e78-b083-d272869b967b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:57 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec 1073741824" returned: 0 in 0.842s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "cinder-quobyte-d1cd3905-88e6-4e78-b083-d272869b967b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-d1cd3905-88e6-4e78-b083-d272869b967b" acquired by "delete_volume" :: waited 0.033s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:57 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec Apr 24 19:26:57 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e25626b-e067-475f-a6da-b32a26de223b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:57 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b Apr 24 19:26:57 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:57 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec" returned: 0 in 0.592s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cdfc0b-031e-45d3-ba87-d7e4efbd6b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d88b540-2b6f-48cb-affe-b17e19f47e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:57 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Volume volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec (01cb4f65-33eb-4afb-aab2-4c3f05d69eec): created successfully Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d88b540-2b6f-48cb-affe-b17e19f47e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:57 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Flow 'volume_create_manager' (46e33b3e-c27f-416e-9d02-62db6f4dd277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b" returned: 0 in 0.592s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:57 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4be7c764-09d3-4353-85b2-1bf3fcd168d6 tempest-CreateVolumesFromImageTest-1818767821 None] Created volume successfully. Apr 24 19:26:57 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b Apr 24 19:26:57 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:58 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d1cd3905-88e6-4e78-b083-d272869b967b" returned: 0 in 0.514s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-quobyte-d1cd3905-88e6-4e78-b083-d272869b967b" released by "delete_volume" :: held 1.163s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Created reservations ['b51bb29f-2b8b-42e2-8755-70c31a93755c', 'c647883e-e190-4ed6-89cf-26d20d4cc1c4', '7f4c211a-0450-460a-ba45-73ccf65eb21c', '2fe25184-260b-42b8-a005-f1ce00792d73'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "cinder-01cb4f65-33eb-4afb-aab2-4c3f05d69eec-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:58 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:58 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-01cb4f65-33eb-4afb-aab2-4c3f05d69eec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "cinder-quobyte-01cb4f65-33eb-4afb-aab2-4c3f05d69eec" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-quobyte-01cb4f65-33eb-4afb-aab2-4c3f05d69eec" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0898696-fadc-4076-ae27-761680b3494a]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:58 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec Apr 24 19:26:58 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:58 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.529s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:59 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Deleted volume successfully. Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-cc4a3b7f-0452-449d-9565-b1915d8915e2 tempest-VolumeDependencyTests-1224771928 None] Lock "cinder-d1cd3905-88e6-4e78-b083-d272869b967b-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:59 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec" returned: 0 in 0.587s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:59 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec Apr 24 19:26:59 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:59 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-01cb4f65-33eb-4afb-aab2-4c3f05d69eec" returned: 0 in 0.491s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-quobyte-01cb4f65-33eb-4afb-aab2-4c3f05d69eec" released by "delete_volume" :: held 1.125s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Created reservations ['52c830ce-668c-4c78-834f-71a0feda5bf0', 'fa04032b-7ec4-4398-b3df-675bf8e578af', '13865892-23eb-4eb7-b045-e3ba26d97e6f', '4e7fc3b4-2662-4bb7-a57c-230d60a673b3'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:59 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:26:59 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:00 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.513s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:00 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:00 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Deleted volume successfully. Apr 24 19:27:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-f0c906b6-11e9-4335-9cc3-fc726418e0c9 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-01cb4f65-33eb-4afb-aab2-4c3f05d69eec-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "cinder-669bd1b8-434c-434b-bcb6-3707ccbedfc3-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-669bd1b8-434c-434b-bcb6-3707ccbedfc3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "cinder-quobyte-669bd1b8-434c-434b-bcb6-3707ccbedfc3" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-quobyte-669bd1b8-434c-434b-bcb6-3707ccbedfc3" acquired by "delete_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:00 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[516ba5fa-9951-4cf9-8518-c02ba9d007dc]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:00 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3 Apr 24 19:27:00 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:01 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3" returned: 0 in 0.526s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:01 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3 Apr 24 19:27:01 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:01 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-669bd1b8-434c-434b-bcb6-3707ccbedfc3" returned: 0 in 0.481s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-quobyte-669bd1b8-434c-434b-bcb6-3707ccbedfc3" released by "delete_volume" :: held 1.052s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Created reservations ['765bc0ee-9dbb-4b0c-897c-08d23f0cecab', '09227db3-1cb7-4c9e-8942-702156e77e98', 'c8eaa7e3-b618-4c44-8185-830ef146f84b', 'e71ad008-1f11-43f7-b8ee-1090156000ce'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:01 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:01 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:02 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.441s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:02 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:02 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Deleted volume successfully. Apr 24 19:27:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-25022a46-0fe6-4ec4-afb8-141096c3e27b tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-669bd1b8-434c-434b-bcb6-3707ccbedfc3-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "cinder-fe9c8536-cfa2-4fd8-9957-6d689e5dc799-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-fe9c8536-cfa2-4fd8-9957-6d689e5dc799-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "cinder-quobyte-fe9c8536-cfa2-4fd8-9957-6d689e5dc799" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-quobyte-fe9c8536-cfa2-4fd8-9957-6d689e5dc799" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:03 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77fd784-2fb7-400c-9c6b-139a258de44a]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:03 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799 Apr 24 19:27:03 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:03 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799" returned: 0 in 0.575s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:03 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799 Apr 24 19:27:03 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:04 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-fe9c8536-cfa2-4fd8-9957-6d689e5dc799" returned: 0 in 0.448s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-quobyte-fe9c8536-cfa2-4fd8-9957-6d689e5dc799" released by "delete_volume" :: held 1.073s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Created reservations ['2a9723a2-0177-429c-af80-7ae83748778e', '0d1ebdf2-acd4-4d33-9d20-204ebe0977b4', '66f88600-c810-4b76-b15a-1d39cead7f55', '21d860df-3869-40b8-b31d-7a7a5da3374c'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:04 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:04 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:04 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.429s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:04 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Deleted volume successfully. Apr 24 19:27:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bd6e4c94-96a0-4881-85f3-62f09f0c5663 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-fe9c8536-cfa2-4fd8-9957-6d689e5dc799-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "cinder-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "cinder-quobyte-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-quobyte-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:05 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c09873-d972-4a57-91e3-e4922b19f0d9]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:05 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 Apr 24 19:27:05 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:05 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14" returned: 0 in 0.572s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:05 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14 Apr 24 19:27:05 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:06 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14" returned: 0 in 0.429s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-quobyte-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14" released by "delete_volume" :: held 1.043s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Created reservations ['e6ef5f0d-70e9-41be-8879-823954f799db', '301ead72-75b6-4c06-a3fd-a1cc91e6aee6', '7539f826-60cd-444a-95a8-e1cca10aa68e', '1e5d22db-935f-4ba5-bb2c-693f676d1892'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:06 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:06 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "cinder-e573ceb8-a536-44f5-bef8-2d4d8ec778c6-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-e573ceb8-a536-44f5-bef8-2d4d8ec778c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "cinder-quobyte-e573ceb8-a536-44f5-bef8-2d4d8ec778c6" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-quobyte-e573ceb8-a536-44f5-bef8-2d4d8ec778c6" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cd5adc-4735-4b15-a749-e1f4db0a638c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:06 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6 Apr 24 19:27:06 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:06 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.510s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:06 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:06 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Deleted volume successfully. Apr 24 19:27:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-89113568-1412-400f-a3ff-98cf9837fb08 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-912fd3e0-e6d6-432d-8ce9-c4f917b9cd14-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:07 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6" returned: 0 in 0.622s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:07 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6 Apr 24 19:27:07 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:07 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-e573ceb8-a536-44f5-bef8-2d4d8ec778c6" returned: 0 in 0.518s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-quobyte-e573ceb8-a536-44f5-bef8-2d4d8ec778c6" released by "delete_volume" :: held 1.180s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:07 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Created reservations ['b08bfa4d-88e9-4534-8f03-4a996005bc3e', '5a4e1fd2-ec93-41c2-a041-8773e5e3048b', '9cad0d2e-a471-4553-ad7f-0a017b2d067a', '3084e343-6001-4e1a-995d-41c85ea1e743'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:08 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:08 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:08 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:08 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.474s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:08 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:08 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Deleted volume successfully. Apr 24 19:27:08 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ff24e026-ac49-4f64-b220-f47ce6688d55 tempest-CreateVolumesFromImageTest-1818767821 None] Lock "cinder-e573ceb8-a536-44f5-bef8-2d4d8ec778c6-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (2bd077b3-e765-4e6d-9eeb-1620a0561024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2793bac-a6d2-4c07-84d2-6a12cf78758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2793bac-a6d2-4c07-84d2-6a12cf78758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114844933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722c9d70-5d76-4154-a002-a0e64b94f20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:14Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05036f7-b967-4242-89c2-f0f6ffee7cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05036f7-b967-4242-89c2-f0f6ffee7cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ddfb55-4ef0-4aed-ac9b-4ef6af38f124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ddfb55-4ef0-4aed-ac9b-4ef6af38f124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722c9d70-5d76-4154-a002-a0e64b94f20b', 'volume_name': 'volume-722c9d70-5d76-4154-a002-a0e64b94f20b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb375c08-446e-4a65-8895-6bf69bcda2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb375c08-446e-4a65-8895-6bf69bcda2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df0edd9-3c7b-45ea-bbff-7810ab2561f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:13 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume 722c9d70-5d76-4154-a002-a0e64b94f20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722c9d70-5d76-4154-a002-a0e64b94f20b', 'volume_size': 1} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114844933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722c9d70-5d76-4154-a002-a0e64b94f20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:14Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Creating volume 722c9d70-5d76-4154-a002-a0e64b94f20b {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:13 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:13 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b 1073741824 Apr 24 19:27:13 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:14 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b 1073741824" returned: 0 in 0.590s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:14 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b Apr 24 19:27:14 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:14 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b" returned: 0 in 0.441s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:14 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df0edd9-3c7b-45ea-bbff-7810ab2561f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722c9d70-5d76-4154-a002-a0e64b94f20b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7d0d5d-1d29-4596-8008-08fc4ef4fda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:14 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume volume-722c9d70-5d76-4154-a002-a0e64b94f20b (722c9d70-5d76-4154-a002-a0e64b94f20b): created successfully Apr 24 19:27:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7d0d5d-1d29-4596-8008-08fc4ef4fda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (2bd077b3-e765-4e6d-9eeb-1620a0561024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:14 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-621366b4-f78a-4878-b862-71e56dc47b8e tempest-CreateVolumesFromSnapshotTest-538983817 None] Created volume successfully. Apr 24 19:27:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Creating offline snapshot de0ccb51-d2c7-4935-9628-079b26386804 of volume 722c9d70-5d76-4154-a002-a0e64b94f20b {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:27:16 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66acb6c-c00c-4e68-9fae-c3a756366c3e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:16 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b Apr 24 19:27:16 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:16 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b" returned: 0 in 0.548s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:16 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 1G Apr 24 19:27:16 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:17 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 1G" returned: 0 in 0.650s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722c9d70-5d76-4154-a002-a0e64b94f20b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:17 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722c9d70-5d76-4154-a002-a0e64b94f20b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 Apr 24 19:27:17 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:17 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722c9d70-5d76-4154-a002-a0e64b94f20b -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804" returned: 0 in 0.516s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:17 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 is being set with open permissions: ugo+rw Apr 24 19:27:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:17 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 Apr 24 19:27:17 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:18 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804" returned: 0 in 0.476s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:18 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.info Apr 24 19:27:18 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:18 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.info" returned: 0 in 0.475s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:18 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.info is being set with open permissions: ugo+rw Apr 24 19:27:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:18 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.info Apr 24 19:27:18 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:19 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.info" returned: 0 in 0.472s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.230s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:19 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-277cdfed-0dbe-4bc2-b7b5-3346d0122a21 tempest-CreateVolumesFromSnapshotTest-538983817 None] Create snapshot completed successfully Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (9ee946e9-b22d-4552-8f3e-77ab815caf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fb6820-de37-4068-8b75-70ed3cba0bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fb6820-de37-4068-8b75-70ed3cba0bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237229345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ff0fef-1b46-4349-9284-ead5859504fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:20Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620440e9-da4b-407f-835c-a9ae1c988d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620440e9-da4b-407f-835c-a9ae1c988d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1707f83-fcb3-4918-9b6f-590838fb922f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1707f83-fcb3-4918-9b6f-590838fb922f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ff0fef-1b46-4349-9284-ead5859504fe', 'volume_name': 'volume-41ff0fef-1b46-4349-9284-ead5859504fe', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5eddd6a-40a5-4899-9af8-f8c8d6c98536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5eddd6a-40a5-4899-9af8-f8c8d6c98536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006cd877-a9dc-4ab9-b6a6-491e78221733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:20 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume 41ff0fef-1b46-4349-9284-ead5859504fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ff0fef-1b46-4349-9284-ead5859504fe', 'volume_size': 1} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237229345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ff0fef-1b46-4349-9284-ead5859504fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:20Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Creating volume 41ff0fef-1b46-4349-9284-ead5859504fe {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:20 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:20 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe 1073741824 Apr 24 19:27:20 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (1b537d30-a94a-477f-b326-c1452ec8a88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b13cf49-b86c-4f07-a97e-a2590df5f60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b13cf49-b86c-4f07-a97e-a2590df5f60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-806919845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e807db-51ac-406d-85d5-003043740655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:21Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee57b0e6-df6d-4e49-a246-1a14e5dd407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee57b0e6-df6d-4e49-a246-1a14e5dd407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18795750-75a8-4d59-acf1-33e66ba86256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18795750-75a8-4d59-acf1-33e66ba86256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e807db-51ac-406d-85d5-003043740655', 'volume_name': 'volume-03e807db-51ac-406d-85d5-003043740655', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1669c2-8143-4a5e-9635-2ea425fab3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1669c2-8143-4a5e-9635-2ea425fab3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e277719c-e4e7-4b27-9135-37abe03b44a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:20 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume 03e807db-51ac-406d-85d5-003043740655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e807db-51ac-406d-85d5-003043740655', 'volume_size': 1} Apr 24 19:27:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (cd5d8470-8e6c-431b-b330-85d4d7a271f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfd6496-c57e-4e38-bbc1-0b569048a10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfd6496-c57e-4e38-bbc1-0b569048a10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1389066413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d77b23d-7bc2-406e-9bbc-b57d18aefc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:21Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129c2442-35cd-46ef-9b83-bebd14dc033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129c2442-35cd-46ef-9b83-bebd14dc033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a3a9ed-f534-4bc0-aabd-cef1c7162bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a3a9ed-f534-4bc0-aabd-cef1c7162bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d77b23d-7bc2-406e-9bbc-b57d18aefc5b', 'volume_name': 'volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc55c7f-dd0f-49d1-aca5-55c1bbf0ca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc55c7f-dd0f-49d1-aca5-55c1bbf0ca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbf47d5-f072-4943-a8b1-85904de2c801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume 3d77b23d-7bc2-406e-9bbc-b57d18aefc5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b', 'volume_size': 1} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:21 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe 1073741824" returned: 0 in 0.716s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:21 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe Apr 24 19:27:21 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (b437222f-b183-4115-a774-fb2a2f1f7947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0e9260-da6e-47e7-afd9-7f4ef5a5536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0e9260-da6e-47e7-afd9-7f4ef5a5536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1531019241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb1f42a-b726-46b1-8fc0-966d2c9e2891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:21Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fc70ab-8209-4e74-b5eb-645b0df1fd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fc70ab-8209-4e74-b5eb-645b0df1fd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943754d6-3a32-426e-8b46-7a0201317144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943754d6-3a32-426e-8b46-7a0201317144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddb1f42a-b726-46b1-8fc0-966d2c9e2891', 'volume_name': 'volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15da368-b4e6-477c-b197-f51df0078d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15da368-b4e6-477c-b197-f51df0078d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36489b38-1d26-42de-8cb2-bd4041f7df5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume ddb1f42a-b726-46b1-8fc0-966d2c9e2891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891', 'volume_size': 1} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (668f209d-d7fa-49fa-b347-7e0067edd94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235df63b-e9aa-4c9a-a9e4-a6663a0cd055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235df63b-e9aa-4c9a-a9e4-a6663a0cd055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706914600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47e1f82-7de9-46da-9aab-75ec87e031ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:22Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bbfad2-90c9-495e-8148-9c51ec1b2ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bbfad2-90c9-495e-8148-9c51ec1b2ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd142763-03d4-4f83-98fb-754b9438cd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd142763-03d4-4f83-98fb-754b9438cd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c47e1f82-7de9-46da-9aab-75ec87e031ec', 'volume_name': 'volume-c47e1f82-7de9-46da-9aab-75ec87e031ec', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d731913-3c5a-49bf-beae-b5562db2930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d731913-3c5a-49bf-beae-b5562db2930e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59f0924-6e5a-45a6-bff1-8f1f391d0f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume c47e1f82-7de9-46da-9aab-75ec87e031ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c47e1f82-7de9-46da-9aab-75ec87e031ec', 'volume_size': 1} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:21 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe" returned: 0 in 0.526s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.977s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-806919845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e807db-51ac-406d-85d5-003043740655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:21Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Creating volume 03e807db-51ac-406d-85d5-003043740655 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:21 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006cd877-a9dc-4ab9-b6a6-491e78221733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ff0fef-1b46-4349-9284-ead5859504fe', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655 1073741824 Apr 24 19:27:21 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ea0c90-683a-4635-abf7-241ac8986f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:21 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume volume-41ff0fef-1b46-4349-9284-ead5859504fe (41ff0fef-1b46-4349-9284-ead5859504fe): created successfully Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ea0c90-683a-4635-abf7-241ac8986f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (9ee946e9-b22d-4552-8f3e-77ab815caf68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:21 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3b6c1736-ded4-4e0e-a291-137dfd600ce1 tempest-CreateVolumesFromSnapshotTest-538983817 None] Created volume successfully. Apr 24 19:27:22 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655 1073741824" returned: 0 in 0.660s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:22 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655 Apr 24 19:27:22 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:23 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655" returned: 0 in 0.487s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1389066413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d77b23d-7bc2-406e-9bbc-b57d18aefc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:21Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Creating volume 3d77b23d-7bc2-406e-9bbc-b57d18aefc5b {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:23 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e277719c-e4e7-4b27-9135-37abe03b44a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e807db-51ac-406d-85d5-003043740655', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:23 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b 1073741824 Apr 24 19:27:23 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059daf6c-0e4b-45a6-86fe-742cae8a6195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:23 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume volume-03e807db-51ac-406d-85d5-003043740655 (03e807db-51ac-406d-85d5-003043740655): created successfully Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059daf6c-0e4b-45a6-86fe-742cae8a6195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (1b537d30-a94a-477f-b326-c1452ec8a88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:23 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-0b97163d-089a-467c-afff-9b4c83e35816 tempest-CreateVolumesFromSnapshotTest-538983817 None] Created volume successfully. Apr 24 19:27:23 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b 1073741824" returned: 0 in 0.632s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:23 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b Apr 24 19:27:23 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:24 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b" returned: 0 in 0.467s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.668s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1531019241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb1f42a-b726-46b1-8fc0-966d2c9e2891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:21Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Creating volume ddb1f42a-b726-46b1-8fc0-966d2c9e2891 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:24 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbf47d5-f072-4943-a8b1-85904de2c801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:24 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891 1073741824 Apr 24 19:27:24 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be2643d-4abc-4842-89c3-282ff07bb292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:24 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b (3d77b23d-7bc2-406e-9bbc-b57d18aefc5b): created successfully Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be2643d-4abc-4842-89c3-282ff07bb292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (cd5d8470-8e6c-431b-b330-85d4d7a271f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1fa246e0-06ee-4172-9385-a31127935720 tempest-CreateVolumesFromSnapshotTest-538983817 None] Created volume successfully. Apr 24 19:27:24 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891 1073741824" returned: 0 in 0.638s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:24 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891 Apr 24 19:27:24 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:25 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891" returned: 0 in 0.467s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.550s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706914600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47e1f82-7de9-46da-9aab-75ec87e031ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c322f12bc4ba0ad4dbebfae32041f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:22Z,use_quota=True,user_id='5489b32b01e247c8ad926cce5351aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Creating volume c47e1f82-7de9-46da-9aab-75ec87e031ec {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:25 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36489b38-1d26-42de-8cb2-bd4041f7df5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295851c6-5482-41f7-9df4-de8fa3f9f07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:25 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec 1073741824 Apr 24 19:27:25 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:25 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891 (ddb1f42a-b726-46b1-8fc0-966d2c9e2891): created successfully Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295851c6-5482-41f7-9df4-de8fa3f9f07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (b437222f-b183-4115-a774-fb2a2f1f7947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:25 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4b30b894-b261-4c7a-a1bc-beb66358fa69 tempest-CreateVolumesFromSnapshotTest-538983817 None] Created volume successfully. Apr 24 19:27:26 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec 1073741824" returned: 0 in 0.690s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:26 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec Apr 24 19:27:26 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:26 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec" returned: 0 in 0.453s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59f0924-6e5a-45a6-bff1-8f1f391d0f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47e1f82-7de9-46da-9aab-75ec87e031ec', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e158f2-cdb8-4961-b53a-a03aa8d63cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:26 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Volume volume-c47e1f82-7de9-46da-9aab-75ec87e031ec (c47e1f82-7de9-46da-9aab-75ec87e031ec): created successfully Apr 24 19:27:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e158f2-cdb8-4961-b53a-a03aa8d63cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Flow 'volume_create_manager' (668f209d-d7fa-49fa-b347-7e0067edd94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:26 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-352f6e12-1cb9-4e71-915e-0f0a63608432 tempest-CreateVolumesFromSnapshotTest-538983817 None] Created volume successfully. Apr 24 19:27:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-c47e1f82-7de9-46da-9aab-75ec87e031ec-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-c47e1f82-7de9-46da-9aab-75ec87e031ec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-quobyte-c47e1f82-7de9-46da-9aab-75ec87e031ec" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-c47e1f82-7de9-46da-9aab-75ec87e031ec" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:27 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[10476eaf-62b9-4542-a9ef-1ddd6bdc8834]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:27 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec Apr 24 19:27:27 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:28 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec" returned: 0 in 0.553s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:28 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec Apr 24 19:27:28 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:28 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c47e1f82-7de9-46da-9aab-75ec87e031ec" returned: 0 in 0.444s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-c47e1f82-7de9-46da-9aab-75ec87e031ec" released by "delete_volume" :: held 1.042s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Created reservations ['4e710c77-b75a-4b8b-a7b1-6da26cb89af8', '1b65a169-9f0f-4ddb-823a-3b5fae7266a7', '3dad2288-3ed3-41db-98ae-526fa8cd24ad', 'cd21f2c1-fe55-4375-8fc5-c5aa6e1251ff'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:28 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:28 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:29 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.444s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:29 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:29 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Deleted volume successfully. Apr 24 19:27:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-6b12a433-12e6-4742-9dac-25ae04fd8b89 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-c47e1f82-7de9-46da-9aab-75ec87e031ec-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-ddb1f42a-b726-46b1-8fc0-966d2c9e2891-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-ddb1f42a-b726-46b1-8fc0-966d2c9e2891-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-quobyte-ddb1f42a-b726-46b1-8fc0-966d2c9e2891" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-ddb1f42a-b726-46b1-8fc0-966d2c9e2891" acquired by "delete_volume" :: waited 0.014s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:29 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f155a3a5-f5ca-44b1-86d1-628ce09e40a3]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:29 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891 Apr 24 19:27:29 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:30 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891" returned: 0 in 0.532s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:30 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891 Apr 24 19:27:30 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:30 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ddb1f42a-b726-46b1-8fc0-966d2c9e2891" returned: 0 in 0.435s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-ddb1f42a-b726-46b1-8fc0-966d2c9e2891" released by "delete_volume" :: held 1.004s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Created reservations ['c5ced9b3-6d86-4125-920d-d4adcf83a440', '87d54fa1-e6b8-4ed0-9fbe-71364735955c', '5749e502-18b1-45df-9801-5c70a0f91331', 'f2892fa9-fb2d-44fe-8c88-c4b028609ee5'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:30 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:30 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:31 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.419s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:31 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:31 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Deleted volume successfully. Apr 24 19:27:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4c19f264-3cf9-496e-9135-1b11396ccba8 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-ddb1f42a-b726-46b1-8fc0-966d2c9e2891-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-quobyte-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:31 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0b0329-5177-4042-931d-acebd63ba8b2]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:32 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b Apr 24 19:27:32 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:32 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b" returned: 0 in 0.518s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:32 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b Apr 24 19:27:32 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:32 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b" returned: 0 in 0.439s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b" released by "delete_volume" :: held 1.006s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:33 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Created reservations ['ada4767a-f50b-4332-9f7f-1fba61abeb27', 'faa78110-865e-44ba-9b10-caf66e5c7caa', 'e5932d6f-9c16-4316-a1eb-d0809e7dad94', 'efb938c0-96b5-4d6a-a759-23c46e362c8f'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:33 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:33 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:33 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.421s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:33 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:33 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Deleted volume successfully. Apr 24 19:27:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-73fe4d1f-09d3-4f1b-97cf-2ff0564c3cbe tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-3d77b23d-7bc2-406e-9bbc-b57d18aefc5b-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-03e807db-51ac-406d-85d5-003043740655-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-03e807db-51ac-406d-85d5-003043740655-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-quobyte-03e807db-51ac-406d-85d5-003043740655" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-03e807db-51ac-406d-85d5-003043740655" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:34 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6370d5f-ca9a-4a91-b8ff-0980fed4bbf1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:34 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655 Apr 24 19:27:34 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:34 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655" returned: 0 in 0.530s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:34 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655 Apr 24 19:27:34 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:35 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-03e807db-51ac-406d-85d5-003043740655" returned: 0 in 0.446s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-03e807db-51ac-406d-85d5-003043740655" released by "delete_volume" :: held 1.017s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Created reservations ['128c4179-a64a-4265-9c1b-a323b93eaaed', '40efeaf0-1e06-443c-b65f-f27aa25f8482', '6f628d98-0f9b-4125-9fed-8a5cc33f9369', '9d154ae5-a1a9-4cb4-a30d-cf3181c2b63d'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:35 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:35 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:35 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.489s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:35 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Deleted volume successfully. Apr 24 19:27:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-9d2ef129-1823-49cc-b738-88c19238ff3d tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-03e807db-51ac-406d-85d5-003043740655-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-41ff0fef-1b46-4349-9284-ead5859504fe-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-41ff0fef-1b46-4349-9284-ead5859504fe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-quobyte-41ff0fef-1b46-4349-9284-ead5859504fe" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-41ff0fef-1b46-4349-9284-ead5859504fe" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:36 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc69952-dff3-47b6-a212-6a14da2fe8a0]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:36 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe Apr 24 19:27:36 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:37 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe" returned: 0 in 0.581s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:37 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe Apr 24 19:27:37 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:37 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-41ff0fef-1b46-4349-9284-ead5859504fe" returned: 0 in 0.511s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-41ff0fef-1b46-4349-9284-ead5859504fe" released by "delete_volume" :: held 1.135s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Created reservations ['f8b1f098-7417-46ff-a714-a009cc501bb0', '888ba6b9-b076-4c48-999d-2d1b31b897aa', '38148bbc-a1b5-4a6c-a666-a4e330bdc4ad', 'fd2ae662-d412-41ae-b8c1-fd5db8046c7d'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:37 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:37 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:38 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.454s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:38 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Deleted volume successfully. Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d4c18ffe-657d-4d8e-bc6e-783cecb66ad0 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-41ff0fef-1b46-4349-9284-ead5859504fe-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-de0ccb51-d2c7-4935-9628-079b26386804-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-de0ccb51-d2c7-4935-9628-079b26386804-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-quobyte-722c9d70-5d76-4154-a002-a0e64b94f20b" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-722c9d70-5d76-4154-a002-a0e64b94f20b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-quobyte-de0ccb51-d2c7-4935-9628-079b26386804" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-de0ccb51-d2c7-4935-9628-079b26386804" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Deleting offline snapshot de0ccb51-d2c7-4935-9628-079b26386804 of volume 722c9d70-5d76-4154-a002-a0e64b94f20b {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] snapshot_file for this snap is: volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ee68b2-111a-499b-a5b9-503399bff0bf]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:38 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 Apr 24 19:27:38 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:39 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804" returned: 0 in 0.538s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722c9d70-5d76-4154-a002-a0e64b94f20b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:27:39 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1c57f6-5d60-4474-8a1b-f1af8d9638e9]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:39 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b Apr 24 19:27:39 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:39 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b" returned: 0 in 0.536s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:39 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 Apr 24 19:27:39 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:40 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804" returned: 0 in 0.522s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:40 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804 Apr 24 19:27:40 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:40 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b.de0ccb51-d2c7-4935-9628-079b26386804" returned: 0 in 0.440s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=108,cinder:UPDATE=172,cinder:DELETE=14,cinder:INSERT=37 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-de0ccb51-d2c7-4935-9628-079b26386804" released by "_delete_snapshot" :: held 2.144s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-722c9d70-5d76-4154-a002-a0e64b94f20b" released by "delete_snapshot" :: held 2.174s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Created reservations ['14fbded7-479d-40e1-bdbc-98b75d8df327', 'da357ec9-1ef3-4018-a907-b8ace016daed', '8031be78-41fc-4b6e-9562-bf9cf9a2a381', 'd3d8f31e-180c-4298-89ce-a8325d5054e9'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:40 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:40 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:40 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Delete snapshot completed successfully. Apr 24 19:27:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34c4d738-8c0f-4c63-bc6b-a3bff6a3ddea tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-de0ccb51-d2c7-4935-9628-079b26386804-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:41 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.431s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:41 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-722c9d70-5d76-4154-a002-a0e64b94f20b-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-722c9d70-5d76-4154-a002-a0e64b94f20b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "cinder-quobyte-722c9d70-5d76-4154-a002-a0e64b94f20b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-722c9d70-5d76-4154-a002-a0e64b94f20b" acquired by "delete_volume" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:41 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e78c3b-380f-45a4-8f82-42166eb8fd93]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:41 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b Apr 24 19:27:41 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:42 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b" returned: 0 in 0.537s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:42 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b Apr 24 19:27:42 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:42 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-722c9d70-5d76-4154-a002-a0e64b94f20b" returned: 0 in 0.422s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-quobyte-722c9d70-5d76-4154-a002-a0e64b94f20b" released by "delete_volume" :: held 1.017s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Created reservations ['de99cdfa-929c-4c8d-8bcd-8902793f66e7', '5dc14b69-2ee1-4f19-9aa4-4e25bb0c6f59', '449f2cf7-391f-42f2-a5a3-f4574dc52e97', '89b45afb-52d3-45d3-be43-3d33ae715ba6'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:42 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:42 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:43 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.435s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:43 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:43 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Deleted volume successfully. Apr 24 19:27:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d757e22b-fafd-43d7-bedc-e7a7edbafc80 tempest-CreateVolumesFromSnapshotTest-538983817 None] Lock "cinder-722c9d70-5d76-4154-a002-a0e64b94f20b-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (536bf1de-7031-4a53-8688-9bd3f5942bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7699d35-75ba-4c61-bb65-64f802aab131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7699d35-75ba-4c61-bb65-64f802aab131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1549363871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c48c343-3036-4324-a591-66a797d78a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:46Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fe72af-e0e5-478c-8454-36e39cd8ecd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fe72af-e0e5-478c-8454-36e39cd8ecd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ffade0-cc7a-4d46-bf00-c016446fa3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ffade0-cc7a-4d46-bf00-c016446fa3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c48c343-3036-4324-a591-66a797d78a4d', 'volume_name': 'volume-5c48c343-3036-4324-a591-66a797d78a4d', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03da4dfa-9d0a-4943-954b-95449d32d403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03da4dfa-9d0a-4943-954b-95449d32d403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ce9e47-f890-4cc0-8a32-e85cbdaf6bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:46 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume 5c48c343-3036-4324-a591-66a797d78a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c48c343-3036-4324-a591-66a797d78a4d', 'volume_size': 1} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1549363871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c48c343-3036-4324-a591-66a797d78a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:46Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Creating volume 5c48c343-3036-4324-a591-66a797d78a4d {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:46 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:46 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d 1073741824 Apr 24 19:27:46 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:47 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d 1073741824" returned: 0 in 0.655s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:47 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d Apr 24 19:27:47 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:47 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d" returned: 0 in 0.461s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ce9e47-f890-4cc0-8a32-e85cbdaf6bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c48c343-3036-4324-a591-66a797d78a4d', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b235fc94-008d-4ed1-be8f-320a92306952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:47 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume volume-5c48c343-3036-4324-a591-66a797d78a4d (5c48c343-3036-4324-a591-66a797d78a4d): created successfully Apr 24 19:27:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b235fc94-008d-4ed1-be8f-320a92306952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (536bf1de-7031-4a53-8688-9bd3f5942bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:47 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-594dfce3-b588-4674-ba15-24cadb7f74b8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created volume successfully. Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (ba77faa8-b470-4d70-89d4-011506cc72f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661e2698-0659-45b2-8156-a8ed75ddcd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661e2698-0659-45b2-8156-a8ed75ddcd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2098478394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf35ce8-ba08-47c9-931a-9deeb422bf95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:49Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2345506f-3f21-45c9-afc5-57955e6717d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2345506f-3f21-45c9-afc5-57955e6717d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1150a6ea-89f1-4846-bcd3-de4623e1cb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1150a6ea-89f1-4846-bcd3-de4623e1cb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf35ce8-ba08-47c9-931a-9deeb422bf95', 'volume_name': 'volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a458e725-04f7-4fea-a2c9-0573c56e2c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a458e725-04f7-4fea-a2c9-0573c56e2c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cfb3e3-a5e7-4936-8516-87e1311a0fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:48 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume cbf35ce8-ba08-47c9-931a-9deeb422bf95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95', 'volume_size': 1} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2098478394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf35ce8-ba08-47c9-931a-9deeb422bf95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:49Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Creating volume cbf35ce8-ba08-47c9-931a-9deeb422bf95 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:48 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:48 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95 1073741824 Apr 24 19:27:48 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (f9dc84b5-6707-4e94-8fb1-4c6542df3b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2095bd-a88c-4dd7-9d45-e400e451e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2095bd-a88c-4dd7-9d45-e400e451e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1594162201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe80cd8-0413-4d30-b5dc-7392484e3285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:49Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ef44c9-1c05-41fb-a68f-0f609841690b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ef44c9-1c05-41fb-a68f-0f609841690b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1b6fc8-89bc-43ba-9dbc-8616fd9317c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1b6fc8-89bc-43ba-9dbc-8616fd9317c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe80cd8-0413-4d30-b5dc-7392484e3285', 'volume_name': 'volume-bbe80cd8-0413-4d30-b5dc-7392484e3285', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea082617-ec25-4f5b-a752-816261be1b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea082617-ec25-4f5b-a752-816261be1b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473f0d46-cbb8-4fd4-889b-a0d6ebfa1c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume bbe80cd8-0413-4d30-b5dc-7392484e3285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe80cd8-0413-4d30-b5dc-7392484e3285', 'volume_size': 1} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (0879ccb7-3e86-403a-8dba-5eba2edad909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4f0830-4f73-48fb-a2d9-33ff3b3c1398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4f0830-4f73-48fb-a2d9-33ff3b3c1398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1024602624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23032948-eb2c-419d-9466-4a3569f08e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:49Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d7b106-4b78-4199-b007-251e611e76c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d7b106-4b78-4199-b007-251e611e76c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba94ea16-c718-4fe5-bc99-502a5055f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba94ea16-c718-4fe5-bc99-502a5055f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23032948-eb2c-419d-9466-4a3569f08e2b', 'volume_name': 'volume-23032948-eb2c-419d-9466-4a3569f08e2b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d265e9e6-1f4b-4b37-a108-6330e11dddd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d265e9e6-1f4b-4b37-a108-6330e11dddd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b903b98-6cf1-4230-8e5e-eb6866d04937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume 23032948-eb2c-419d-9466-4a3569f08e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23032948-eb2c-419d-9466-4a3569f08e2b', 'volume_size': 1} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:49 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95 1073741824" returned: 0 in 0.693s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:49 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95 Apr 24 19:27:49 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (1313070c-03b0-417b-a1fd-47c925159d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60a7b94-820f-4da8-8bd9-2077e6a72c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60a7b94-820f-4da8-8bd9-2077e6a72c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1182204917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:50Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd70f94f-75c9-4e49-aea0-38942f2bfec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd70f94f-75c9-4e49-aea0-38942f2bfec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcfc442-f8c6-43e6-a8c5-a6dd10b495dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcfc442-f8c6-43e6-a8c5-a6dd10b495dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b', 'volume_name': 'volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f03e63f-8ad6-4d76-90ba-4f5817b9dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f03e63f-8ad6-4d76-90ba-4f5817b9dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21559cbc-d319-4e7a-85f0-ce5160236c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b', 'volume_size': 1} Apr 24 19:27:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (df513732-e6cc-449a-a831-241f58acbeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ddcb23-391c-4c95-bc8b-e7100782c22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ddcb23-391c-4c95-bc8b-e7100782c22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1038619148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c83a9bb-06d4-44e7-8c44-d311607f5298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:50Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89ffe62-afdc-4823-8f52-8e0147280e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89ffe62-afdc-4823-8f52-8e0147280e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3185daca-0e2b-478e-98bd-ae5a5b7f7c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3185daca-0e2b-478e-98bd-ae5a5b7f7c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c83a9bb-06d4-44e7-8c44-d311607f5298', 'volume_name': 'volume-1c83a9bb-06d4-44e7-8c44-d311607f5298', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c2863a-ab6c-49cc-872e-04b215f880cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c2863a-ab6c-49cc-872e-04b215f880cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b4154f-3ea0-4f63-9e36-4736c86cded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:50 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume 1c83a9bb-06d4-44e7-8c44-d311607f5298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c83a9bb-06d4-44e7-8c44-d311607f5298', 'volume_size': 1} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:50 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95" returned: 0 in 0.513s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1594162201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe80cd8-0413-4d30-b5dc-7392484e3285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:49Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Creating volume bbe80cd8-0413-4d30-b5dc-7392484e3285 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:50 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cfb3e3-a5e7-4936-8516-87e1311a0fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:50 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285 1073741824 Apr 24 19:27:50 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489dc9ea-f47a-48ef-8c3d-b8db14917fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:50 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95 (cbf35ce8-ba08-47c9-931a-9deeb422bf95): created successfully Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489dc9ea-f47a-48ef-8c3d-b8db14917fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (ba77faa8-b470-4d70-89d4-011506cc72f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:50 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9667bac2-4272-421a-b11f-b826bd4f6e31 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created volume successfully. Apr 24 19:27:50 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285 1073741824" returned: 0 in 0.600s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:50 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285 Apr 24 19:27:50 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:51 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285" returned: 0 in 0.458s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.718s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1024602624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23032948-eb2c-419d-9466-4a3569f08e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:49Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Creating volume 23032948-eb2c-419d-9466-4a3569f08e2b {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:51 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473f0d46-cbb8-4fd4-889b-a0d6ebfa1c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe80cd8-0413-4d30-b5dc-7392484e3285', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:51 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b 1073741824 Apr 24 19:27:51 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910fc39e-b56e-490d-bb17-cd40943fcb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:51 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume volume-bbe80cd8-0413-4d30-b5dc-7392484e3285 (bbe80cd8-0413-4d30-b5dc-7392484e3285): created successfully Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910fc39e-b56e-490d-bb17-cd40943fcb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (f9dc84b5-6707-4e94-8fb1-4c6542df3b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:51 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-cefb54a2-c7eb-47dd-b885-599ced7e8c3d tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created volume successfully. Apr 24 19:27:51 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b 1073741824" returned: 0 in 0.623s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=151,cinder:SELECT=111,cinder:INSERT=31,cinder:DELETE=17 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:27:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:51 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b Apr 24 19:27:51 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:52 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b" returned: 0 in 0.452s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.573s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1182204917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:50Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Creating volume b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:52 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b903b98-6cf1-4230-8e5e-eb6866d04937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23032948-eb2c-419d-9466-4a3569f08e2b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413bbb88-a24d-4407-b78a-40a1cf5b6738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:52 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b 1073741824 Apr 24 19:27:52 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:52 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume volume-23032948-eb2c-419d-9466-4a3569f08e2b (23032948-eb2c-419d-9466-4a3569f08e2b): created successfully Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413bbb88-a24d-4407-b78a-40a1cf5b6738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:52 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (0879ccb7-3e86-403a-8dba-5eba2edad909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-82281fa2-84f2-43b9-962c-82f167feca39 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created volume successfully. Apr 24 19:27:53 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b 1073741824" returned: 0 in 0.619s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:53 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b Apr 24 19:27:53 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:53 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b" returned: 0 in 0.457s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.439s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1038619148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c83a9bb-06d4-44e7-8c44-d311607f5298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449779b50654e6ca35cbb63716ec711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:27:50Z,use_quota=True,user_id='1676dceb7b5b4bc6b3e8edfeb36adc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Creating volume 1c83a9bb-06d4-44e7-8c44-d311607f5298 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:27:53 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:53 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298 1073741824 Apr 24 19:27:53 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21559cbc-d319-4e7a-85f0-ce5160236c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a4d66a-fa61-45aa-b112-90667259d2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:53 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b (b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b): created successfully Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a4d66a-fa61-45aa-b112-90667259d2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (1313070c-03b0-417b-a1fd-47c925159d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:53 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3d1beb3b-59f5-46ae-ad5f-ed45dca9a8df tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created volume successfully. Apr 24 19:27:54 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298 1073741824" returned: 0 in 0.650s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:54 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298 Apr 24 19:27:54 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:54 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298" returned: 0 in 0.511s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:27:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b4154f-3ea0-4f63-9e36-4736c86cded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c83a9bb-06d4-44e7-8c44-d311607f5298', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c43e7d1-6936-4f32-9593-071ab0953cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:27:54 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Volume volume-1c83a9bb-06d4-44e7-8c44-d311607f5298 (1c83a9bb-06d4-44e7-8c44-d311607f5298): created successfully Apr 24 19:27:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c43e7d1-6936-4f32-9593-071ab0953cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:27:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Flow 'volume_create_manager' (df513732-e6cc-449a-a831-241f58acbeb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:27:54 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-55141141-13e4-42e2-b518-99a14a0190fa tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created volume successfully. Apr 24 19:27:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-1c83a9bb-06d4-44e7-8c44-d311607f5298-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-1c83a9bb-06d4-44e7-8c44-d311607f5298-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-quobyte-1c83a9bb-06d4-44e7-8c44-d311607f5298" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-1c83a9bb-06d4-44e7-8c44-d311607f5298" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:55 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2fe4e5-edfb-4e0d-8e48-7212e1583362]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:55 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298 Apr 24 19:27:55 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:56 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298" returned: 0 in 0.594s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:56 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298 Apr 24 19:27:56 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:56 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1c83a9bb-06d4-44e7-8c44-d311607f5298" returned: 0 in 0.510s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-1c83a9bb-06d4-44e7-8c44-d311607f5298" released by "delete_volume" :: held 1.151s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created reservations ['ec120a12-c135-49de-999d-3eaafd22184c', 'e5e3e638-882e-4d00-b9cc-65a0ea368b15', '5774f342-79a3-4216-b59b-102bf94e9468', 'e895233b-82f9-4d8a-b61b-df2ee5157d9a'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:56 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:56 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:57 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.474s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:57 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:57 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Deleted volume successfully. Apr 24 19:27:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-e947160a-86b8-423c-979c-382a95dcfa56 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-1c83a9bb-06d4-44e7-8c44-d311607f5298-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-quobyte-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:27:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:27:57 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[422ebdc5-a934-4604-8fee-6ae190e88a5c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:27:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:58 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b Apr 24 19:27:58 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:58 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b" returned: 0 in 0.567s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:58 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b Apr 24 19:27:58 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:58 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b" returned: 0 in 0.471s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b" released by "delete_volume" :: held 1.096s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created reservations ['ce8a24b9-0ec0-4f70-a0c7-c0a0e8015aa5', '5447af8c-6b28-4568-b901-4fee1522bdd1', 'da4807b8-674f-46c1-905a-ba9170b4f11a', 'c50140e2-694f-4ac0-a577-00257a8a1c04'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:27:59 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:27:59 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:27:59 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.449s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:27:59 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Deleted volume successfully. Apr 24 19:27:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-29079beb-8915-4071-9772-38129bc3812c tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-b6dff45e-b2e8-4cd7-8f42-3ad5caa8f51b-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-23032948-eb2c-419d-9466-4a3569f08e2b-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-23032948-eb2c-419d-9466-4a3569f08e2b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-quobyte-23032948-eb2c-419d-9466-4a3569f08e2b" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-23032948-eb2c-419d-9466-4a3569f08e2b" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:00 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[db66f40f-3701-42f5-9ea3-676156ccaa93]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:00 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b Apr 24 19:28:00 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:00 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b" returned: 0 in 0.535s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:00 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b Apr 24 19:28:00 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:01 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-23032948-eb2c-419d-9466-4a3569f08e2b" returned: 0 in 0.467s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-23032948-eb2c-419d-9466-4a3569f08e2b" released by "delete_volume" :: held 1.042s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created reservations ['142474c7-ed96-4d2d-95d1-dfc0d397aa9e', 'a85aa939-fec8-4234-9fac-0ff8925ee78d', '85ec3a6d-5722-4681-af00-70c8b8916651', 'f84786de-f4c1-4836-a416-5b4fba8b249d'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:01 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:01 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:01 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.457s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:01 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Deleted volume successfully. Apr 24 19:28:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-549f327c-4861-48ac-90f6-6c7ba7ad5ae0 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-23032948-eb2c-419d-9466-4a3569f08e2b-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-bbe80cd8-0413-4d30-b5dc-7392484e3285-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-bbe80cd8-0413-4d30-b5dc-7392484e3285-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-quobyte-bbe80cd8-0413-4d30-b5dc-7392484e3285" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-bbe80cd8-0413-4d30-b5dc-7392484e3285" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:02 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfe21db-6658-4966-a8ed-2fbb6882790e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:02 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285 Apr 24 19:28:02 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:02 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285" returned: 0 in 0.545s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:02 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285 Apr 24 19:28:02 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:03 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-bbe80cd8-0413-4d30-b5dc-7392484e3285" returned: 0 in 0.443s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-bbe80cd8-0413-4d30-b5dc-7392484e3285" released by "delete_volume" :: held 1.030s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created reservations ['e6ca5218-c14e-46b5-9883-222e1ee0773f', 'ec13979c-7c05-44b6-9a33-2a09b020dc50', '7dce3e6c-b21e-4048-aff4-9232f9f50c1a', 'd9f6367d-47d4-4cb4-856c-6b2cb3bf8efd'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:03 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:03 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:03 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.436s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:03 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Deleted volume successfully. Apr 24 19:28:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-34f57628-2e88-444a-8f30-45d75d6535e6 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-bbe80cd8-0413-4d30-b5dc-7392484e3285-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-cbf35ce8-ba08-47c9-931a-9deeb422bf95-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-cbf35ce8-ba08-47c9-931a-9deeb422bf95-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-quobyte-cbf35ce8-ba08-47c9-931a-9deeb422bf95" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-cbf35ce8-ba08-47c9-931a-9deeb422bf95" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:04 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca1fa00-373c-4765-a1ea-02693e524e3e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:04 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95 Apr 24 19:28:04 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:05 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95" returned: 0 in 0.531s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:05 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95 Apr 24 19:28:05 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:05 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-cbf35ce8-ba08-47c9-931a-9deeb422bf95" returned: 0 in 0.454s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-cbf35ce8-ba08-47c9-931a-9deeb422bf95" released by "delete_volume" :: held 1.024s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created reservations ['bd6f97b2-b137-4a34-85ff-0ea26eed1100', 'c70b3bc2-e41d-4e3f-9d12-f133103d44a8', 'cc9dfefa-1911-4faf-a2e7-1898f1493cb7', 'f3036132-8f4a-4a38-ad16-1f12e088e71a'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:05 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:05 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:06 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.470s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:06 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:06 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Deleted volume successfully. Apr 24 19:28:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c0502f7d-eef8-4995-815d-1e197d1c1b9f tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-cbf35ce8-ba08-47c9-931a-9deeb422bf95-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-5c48c343-3036-4324-a591-66a797d78a4d-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-5c48c343-3036-4324-a591-66a797d78a4d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "cinder-quobyte-5c48c343-3036-4324-a591-66a797d78a4d" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:06 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-5c48c343-3036-4324-a591-66a797d78a4d" acquired by "delete_volume" :: waited 0.014s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:06 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ffbf45-0e7d-48c2-b8b5-cfc333a054af]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:06 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d Apr 24 19:28:06 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:07 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d" returned: 0 in 0.529s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:07 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d Apr 24 19:28:07 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:07 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-5c48c343-3036-4324-a591-66a797d78a4d" returned: 0 in 0.459s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-quobyte-5c48c343-3036-4324-a591-66a797d78a4d" released by "delete_volume" :: held 1.029s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Created reservations ['c288455e-21e3-4289-a51a-2350c0f6ded6', '4191fc02-9803-45d5-9699-a64565326f84', 'e5123544-23cf-404d-9b10-0cc570a3d56a', 'bcce5875-ee39-4d3a-a705-85448212df71'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:07 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:07 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:07 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:08 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.408s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:08 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:08 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Deleted volume successfully. Apr 24 19:28:08 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-5daab61d-41a4-4ec7-ad19-def6c190f1e8 tempest-CreateVolumesFromSourceVolumeTest-927916357 None] Lock "cinder-5c48c343-3036-4324-a591-66a797d78a4d-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:17 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=51,cinder:INSERT=21,cinder:UPDATE=89,cinder:DELETE=4 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Flow 'volume_create_manager' (60661ec3-5c51-4c60-9426-57f1fc0688ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db00195a-7d0a-4d6e-a7d3-01a8225e282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db00195a-7d0a-4d6e-a7d3-01a8225e282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631422651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7ef061-972c-4dec-b7fc-79d9c2a9b482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be5e2791f94e4a9c1624a7c3bece4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:18Z,use_quota=True,user_id='f4d6489e653a4e72ac447444eee4641e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b18971-ad29-45bc-b6f1-04c928502bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b18971-ad29-45bc-b6f1-04c928502bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a0ad8d-f30b-4e54-bc71-ad17d4d136e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a0ad8d-f30b-4e54-bc71-ad17d4d136e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec7ef061-972c-4dec-b7fc-79d9c2a9b482', 'volume_name': 'volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d83ecb-7b8e-4b38-a7cf-781d43c19d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d83ecb-7b8e-4b38-a7cf-781d43c19d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85625ffc-ea39-4ad0-8485-2668ed0fb817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Volume ec7ef061-972c-4dec-b7fc-79d9c2a9b482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482', 'volume_size': 1} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631422651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7ef061-972c-4dec-b7fc-79d9c2a9b482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be5e2791f94e4a9c1624a7c3bece4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:18Z,use_quota=True,user_id='f4d6489e653a4e72ac447444eee4641e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Creating volume ec7ef061-972c-4dec-b7fc-79d9c2a9b482 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:18 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Flow 'volume_create_manager' (af1d9f0b-5406-4ab3-94d8-13b057b13089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7519a3ba-94c7-4cfd-a384-312d7c963aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7519a3ba-94c7-4cfd-a384-312d7c963aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-795148212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2548b8-ccb7-4254-a650-fba86554570d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9e81f42985488b855ef40ff0c84ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:18Z,use_quota=True,user_id='e2164092bcc844bba2653b7611ac7348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c84a87-3f03-417c-bfc8-e5bd87ab642c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c84a87-3f03-417c-bfc8-e5bd87ab642c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482 1073741824 Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89efea15-643f-4eb1-989f-80f9e490535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89efea15-643f-4eb1-989f-80f9e490535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e2548b8-ccb7-4254-a650-fba86554570d', 'volume_name': 'volume-2e2548b8-ccb7-4254-a650-fba86554570d', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f1ec19-0af7-4795-9bc1-823755706f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f1ec19-0af7-4795-9bc1-823755706f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20f1fb7-4fdb-4f62-a3cc-09403fcd63e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Volume 2e2548b8-ccb7-4254-a650-fba86554570d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e2548b8-ccb7-4254-a650-fba86554570d', 'volume_size': 1} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (a9e64656-5ad2-4f06-8300-9434707d06a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46ed2c6-2807-4cfb-a8a0-726a3911d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46ed2c6-2807-4cfb-a8a0-726a3911d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1675387597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:18Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33afc3c-d1dc-421b-9dfb-96cac26b8f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33afc3c-d1dc-421b-9dfb-96cac26b8f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d726f89-d983-4af4-b48b-331258269979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d726f89-d983-4af4-b48b-331258269979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f', 'volume_name': 'volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa896ab-5643-4ceb-b707-ae79eedc6249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa896ab-5643-4ceb-b707-ae79eedc6249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eeb9a32-ba19-4d97-b53c-835aea717deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume 0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f', 'volume_size': 1} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Flow 'volume_create_manager' (64f8e74f-35c2-4724-a520-4073085dd22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9c4c58-ce85-4471-9c40-958fddc38f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9c4c58-ce85-4471-9c40-958fddc38f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-521969750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19bad6b6-68c5-4424-9184-c84fe1081bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be5e2791f94e4a9c1624a7c3bece4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:18Z,use_quota=True,user_id='f4d6489e653a4e72ac447444eee4641e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709481a1-1f98-4a92-a273-17cfe52ba065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709481a1-1f98-4a92-a273-17cfe52ba065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdef6e8-ddf5-45a8-afa2-da4d4e6d808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdef6e8-ddf5-45a8-afa2-da4d4e6d808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19bad6b6-68c5-4424-9184-c84fe1081bf2', 'volume_name': 'volume-19bad6b6-68c5-4424-9184-c84fe1081bf2', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913e5ce9-a34b-4866-a448-0249a6851483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913e5ce9-a34b-4866-a448-0249a6851483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6962bf41-9c8f-48da-9cd6-ea9a08d1b803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Volume 19bad6b6-68c5-4424-9184-c84fe1081bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19bad6b6-68c5-4424-9184-c84fe1081bf2', 'volume_size': 1} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Flow 'volume_create_manager' (5748e409-e947-4d5d-ba7d-40ab89e83eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1e681e-d782-422c-b209-e4afa6c1a0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1e681e-d782-422c-b209-e4afa6c1a0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-243343151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed537225-0acb-4562-8fa1-498abc1bda81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be5e2791f94e4a9c1624a7c3bece4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:19Z,use_quota=True,user_id='f4d6489e653a4e72ac447444eee4641e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1663851c-0ac8-4b8d-858a-6d061d60476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1663851c-0ac8-4b8d-858a-6d061d60476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a713e0-fcbd-4294-a76f-16f2d1f38755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a713e0-fcbd-4294-a76f-16f2d1f38755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed537225-0acb-4562-8fa1-498abc1bda81', 'volume_name': 'volume-ed537225-0acb-4562-8fa1-498abc1bda81', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8f1a7e-25c3-446d-a94f-923c87e5e2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8f1a7e-25c3-446d-a94f-923c87e5e2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8609f119-5fb7-4550-9050-988bc9432ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:18 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Volume ed537225-0acb-4562-8fa1-498abc1bda81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed537225-0acb-4562-8fa1-498abc1bda81', 'volume_size': 1} Apr 24 19:28:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:19 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482 1073741824" returned: 0 in 1.036s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:19 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482 Apr 24 19:28:19 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Flow 'volume_create_manager' (31b4d713-e8c5-4737-adad-cb97f5466bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756708dd-1c98-45a3-98dc-0f67ae6397ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756708dd-1c98-45a3-98dc-0f67ae6397ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-715912088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67c7a93-6121-49f0-b02e-2d6b41423994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be5e2791f94e4a9c1624a7c3bece4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:19Z,use_quota=True,user_id='f4d6489e653a4e72ac447444eee4641e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2d84cb-2a4d-4fa4-82e9-0084c539d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2d84cb-2a4d-4fa4-82e9-0084c539d23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297242a5-d76d-40d6-a6c3-da2f08b7978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297242a5-d76d-40d6-a6c3-da2f08b7978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67c7a93-6121-49f0-b02e-2d6b41423994', 'volume_name': 'volume-c67c7a93-6121-49f0-b02e-2d6b41423994', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad415ac-00ed-423f-afb8-86980a13ad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad415ac-00ed-423f-afb8-86980a13ad31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8882ad-6fa9-4def-8d93-073bba178046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Volume c67c7a93-6121-49f0-b02e-2d6b41423994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67c7a93-6121-49f0-b02e-2d6b41423994', 'volume_size': 1} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Flow 'volume_create_manager' (6ca4b92b-d357-4b07-a035-80cd43cbf5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b290074a-2d48-4009-b875-e5058bf4b87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b290074a-2d48-4009-b875-e5058bf4b87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-714570361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e15546-912f-4099-9a70-137d4c46f260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be5e2791f94e4a9c1624a7c3bece4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:20Z,use_quota=True,user_id='f4d6489e653a4e72ac447444eee4641e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f438e246-b217-4a0c-a24f-5113990c11b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f438e246-b217-4a0c-a24f-5113990c11b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b771c9-fbd0-4f80-bf4c-0e3cfc22281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b771c9-fbd0-4f80-bf4c-0e3cfc22281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e15546-912f-4099-9a70-137d4c46f260', 'volume_name': 'volume-91e15546-912f-4099-9a70-137d4c46f260', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1b5cee-20f6-47fe-9465-648ac089b9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1b5cee-20f6-47fe-9465-648ac089b9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b3fbab-e957-4be6-b479-ce34783989fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Volume 91e15546-912f-4099-9a70-137d4c46f260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e15546-912f-4099-9a70-137d4c46f260', 'volume_size': 1} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:19 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482" returned: 0 in 0.617s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-795148212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2548b8-ccb7-4254-a650-fba86554570d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9e81f42985488b855ef40ff0c84ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:18Z,use_quota=True,user_id='e2164092bcc844bba2653b7611ac7348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Creating volume 2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:19 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:19 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d 1073741824 Apr 24 19:28:19 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85625ffc-ea39-4ad0-8485-2668ed0fb817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d264ca-d668-4c7c-be87-09cc2ec2f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:19 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Volume volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482 (ec7ef061-972c-4dec-b7fc-79d9c2a9b482): created successfully Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d264ca-d668-4c7c-be87-09cc2ec2f121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:19 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Flow 'volume_create_manager' (60661ec3-5c51-4c60-9426-57f1fc0688ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:19 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-097d67b1-e7bf-4828-8d01-b8e474daa870 tempest-CreateVolumesFromImageTest-1664180045 None] Created volume successfully. Apr 24 19:28:20 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d 1073741824" returned: 0 in 0.758s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:20 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d Apr 24 19:28:20 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:21 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d" returned: 0 in 0.509s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.556s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1675387597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:18Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Creating volume 0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:21 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:21 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f 1073741824 Apr 24 19:28:21 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20f1fb7-4fdb-4f62-a3cc-09403fcd63e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2548b8-ccb7-4254-a650-fba86554570d', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23638ca4-9a97-40c9-8142-818fdef8d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:21 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Volume volume-2e2548b8-ccb7-4254-a650-fba86554570d (2e2548b8-ccb7-4254-a650-fba86554570d): created successfully Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23638ca4-9a97-40c9-8142-818fdef8d242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Flow 'volume_create_manager' (af1d9f0b-5406-4ab3-94d8-13b057b13089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:21 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-8fd1e7c6-9190-4b16-83ca-ce6fc12d324a tempest-VolumeDependencyTests-154960378 None] Created volume successfully. Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:21 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f 1073741824" returned: 0 in 0.844s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:22 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f Apr 24 19:28:22 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:22 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" returned: 0 in 0.546s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.852s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-521969750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19bad6b6-68c5-4424-9184-c84fe1081bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be5e2791f94e4a9c1624a7c3bece4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:18Z,use_quota=True,user_id='f4d6489e653a4e72ac447444eee4641e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Creating volume 19bad6b6-68c5-4424-9184-c84fe1081bf2 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:22 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eeb9a32-ba19-4d97-b53c-835aea717deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da008063-6c35-4371-9f94-a206f1138628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:22 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2 1073741824 Apr 24 19:28:22 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:22 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f (0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f): created successfully Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da008063-6c35-4371-9f94-a206f1138628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:22 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (a9e64656-5ad2-4f06-8300-9434707d06a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:22 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1aae066f-9ec9-4070-b5bf-d04888db64ab tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created volume successfully. Apr 24 19:28:23 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2 1073741824" returned: 0 in 0.760s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:23 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2 Apr 24 19:28:23 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:24 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2" returned: 0 in 0.633s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.104s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-243343151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed537225-0acb-4562-8fa1-498abc1bda81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be5e2791f94e4a9c1624a7c3bece4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:19Z,use_quota=True,user_id='f4d6489e653a4e72ac447444eee4641e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Creating volume ed537225-0acb-4562-8fa1-498abc1bda81 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:24 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6962bf41-9c8f-48da-9cd6-ea9a08d1b803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19bad6b6-68c5-4424-9184-c84fe1081bf2', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3ecb11-24c6-408d-82c7-cd03996791ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:24 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81 1073741824 Apr 24 19:28:24 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:24 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Volume volume-19bad6b6-68c5-4424-9184-c84fe1081bf2 (19bad6b6-68c5-4424-9184-c84fe1081bf2): created successfully Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3ecb11-24c6-408d-82c7-cd03996791ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Flow 'volume_create_manager' (64f8e74f-35c2-4724-a520-4073085dd22b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-e2227537-7539-4ca3-af26-46f9349a4475 tempest-CreateVolumesFromImageTest-1664180045 None] Created volume successfully. Apr 24 19:28:24 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81 1073741824" returned: 0 in 0.698s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:24 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81 Apr 24 19:28:24 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:25 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81" returned: 0 in 0.582s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-715912088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67c7a93-6121-49f0-b02e-2d6b41423994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be5e2791f94e4a9c1624a7c3bece4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:19Z,use_quota=True,user_id='f4d6489e653a4e72ac447444eee4641e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Creating volume c67c7a93-6121-49f0-b02e-2d6b41423994 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:25 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8609f119-5fb7-4550-9050-988bc9432ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed537225-0acb-4562-8fa1-498abc1bda81', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bf4dd1-e0ee-425d-bf19-8ff5c314e04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:25 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994 1073741824 Apr 24 19:28:25 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:25 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Volume volume-ed537225-0acb-4562-8fa1-498abc1bda81 (ed537225-0acb-4562-8fa1-498abc1bda81): created successfully Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bf4dd1-e0ee-425d-bf19-8ff5c314e04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:25 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Flow 'volume_create_manager' (5748e409-e947-4d5d-ba7d-40ab89e83eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:25 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-2e94494f-3dd2-4e5d-9928-bc3888e56389 tempest-CreateVolumesFromImageTest-1664180045 None] Created volume successfully. Apr 24 19:28:26 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994 1073741824" returned: 0 in 0.806s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:26 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994 Apr 24 19:28:26 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:26 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994" returned: 0 in 0.472s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.081s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-714570361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e15546-912f-4099-9a70-137d4c46f260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be5e2791f94e4a9c1624a7c3bece4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:20Z,use_quota=True,user_id='f4d6489e653a4e72ac447444eee4641e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Creating volume 91e15546-912f-4099-9a70-137d4c46f260 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:26 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:26 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260 1073741824 Apr 24 19:28:26 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8882ad-6fa9-4def-8d93-073bba178046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67c7a93-6121-49f0-b02e-2d6b41423994', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beee6a69-9e43-44c9-aff0-c7ccd56e1eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:26 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Volume volume-c67c7a93-6121-49f0-b02e-2d6b41423994 (c67c7a93-6121-49f0-b02e-2d6b41423994): created successfully Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beee6a69-9e43-44c9-aff0-c7ccd56e1eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:26 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Flow 'volume_create_manager' (31b4d713-e8c5-4737-adad-cb97f5466bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:26 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4c84a570-d602-4989-93d6-ffb2b242c079 tempest-CreateVolumesFromImageTest-1664180045 None] Created volume successfully. Apr 24 19:28:27 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260 1073741824" returned: 0 in 0.750s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:27 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260 Apr 24 19:28:27 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:28 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260" returned: 0 in 0.505s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.078s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b3fbab-e957-4be6-b479-ce34783989fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e15546-912f-4099-9a70-137d4c46f260', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8e185f-3633-486a-9bcd-35282a293c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Creating offline snapshot 3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 of volume 2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:28:28 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Volume volume-91e15546-912f-4099-9a70-137d4c46f260 (91e15546-912f-4099-9a70-137d4c46f260): created successfully Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8e185f-3633-486a-9bcd-35282a293c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Flow 'volume_create_manager' (6ca4b92b-d357-4b07-a035-80cd43cbf5b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda148ae-b160-408d-b6bd-10aab93c79e1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f9733f63-bd89-413e-afd6-5098dfbb530b tempest-CreateVolumesFromImageTest-1664180045 None] Created volume successfully. Apr 24 19:28:28 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d Apr 24 19:28:28 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "cinder-91e15546-912f-4099-9a70-137d4c46f260-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-91e15546-912f-4099-9a70-137d4c46f260-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "cinder-quobyte-91e15546-912f-4099-9a70-137d4c46f260" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-quobyte-91e15546-912f-4099-9a70-137d4c46f260" acquired by "delete_volume" :: waited 0.029s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[da56d234-8146-447a-b702-0fa2d78d923a]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:28 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260 Apr 24 19:28:28 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:28 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d" returned: 0 in 0.764s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:28 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 1G Apr 24 19:28:28 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:29 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260" returned: 0 in 0.632s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:29 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260 Apr 24 19:28:29 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:29 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 1G" returned: 0 in 0.734s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2548b8-ccb7-4254-a650-fba86554570d -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:29 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2548b8-ccb7-4254-a650-fba86554570d -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 Apr 24 19:28:29 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:29 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-91e15546-912f-4099-9a70-137d4c46f260" returned: 0 in 0.602s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-quobyte-91e15546-912f-4099-9a70-137d4c46f260" released by "delete_volume" :: held 1.284s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Created reservations ['d130dfd8-f3f8-4772-9081-ba7e058e87f7', '20791b23-f751-46e1-be2e-b0d7225f0de0', '5cd77d3d-abe6-4f19-a992-9ab09787bb5c', 'a170aa87-1ae5-4c89-8205-6755a237ac33'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:29 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:29 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:30 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2548b8-ccb7-4254-a650-fba86554570d -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8" returned: 0 in 0.666s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:30 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 is being set with open permissions: ugo+rw Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:30 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 Apr 24 19:28:30 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:30 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.583s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:30 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Deleted volume successfully. Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3c1de0cb-db55-4b27-a27a-219e72b69824 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-91e15546-912f-4099-9a70-137d4c46f260-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "cinder-c67c7a93-6121-49f0-b02e-2d6b41423994-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-c67c7a93-6121-49f0-b02e-2d6b41423994-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "cinder-quobyte-c67c7a93-6121-49f0-b02e-2d6b41423994" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-quobyte-c67c7a93-6121-49f0-b02e-2d6b41423994" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f21533c-0583-4c83-81f9-a02a541b52d6]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:30 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8" returned: 0 in 0.636s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:30 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994 Apr 24 19:28:30 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:30 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.info Apr 24 19:28:30 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:31 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994" returned: 0 in 0.657s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:31 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994 Apr 24 19:28:31 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:31 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.info" returned: 0 in 0.582s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:31 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.info is being set with open permissions: ugo+rw Apr 24 19:28:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:31 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.info Apr 24 19:28:31 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:31 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c67c7a93-6121-49f0-b02e-2d6b41423994" returned: 0 in 0.540s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-quobyte-c67c7a93-6121-49f0-b02e-2d6b41423994" released by "delete_volume" :: held 1.246s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Created reservations ['1c736dab-0e27-4986-8132-83041c720963', '52c0a8e6-4328-4e0b-a1da-e4ca509e6435', '1102c873-ed84-4246-8e4e-c3d66b7ee9d1', '6bd4b41b-459f-4e4c-91c2-9790f317aca0'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:32 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.info" returned: 0 in 0.567s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.074s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.936s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Creating offline snapshot b1e1aa17-7f6a-41bf-954a-5effbeb0924f of volume 0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[106ec283-dddb-4c11-9c21-d28e5fdfcde3]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:32 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4f3e49cb-6ded-4689-a0fc-7b9a081661f3 tempest-VolumeDependencyTests-154960378 None] Create snapshot completed successfully Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:32 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f Apr 24 19:28:32 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:32 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:32 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Flow 'volume_create_manager' (91158905-79de-4958-8a74-5933ad0592d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3369c0d1-3cb2-44c8-b8ee-61f7f924a398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:32 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.670s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:32 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:32 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Deleted volume successfully. Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3369c0d1-3cb2-44c8-b8ee-61f7f924a398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1694401451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af65988-992c-4d4f-8a74-34764e2fdbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9e81f42985488b855ef40ff0c84ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3abe6d24-2ffc-47ab-81cd-14c653bfc7c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:33Z,use_quota=True,user_id='e2164092bcc844bba2653b7611ac7348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f06a88-24d1-4c8b-b9cb-12f6f12571fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:33 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f06a88-24d1-4c8b-b9cb-12f6f12571fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53dde6c-48ed-427d-a6bd-304795501145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53dde6c-48ed-427d-a6bd-304795501145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3af65988-992c-4d4f-8a74-34764e2fdbd8', 'volume_name': 'volume-3af65988-992c-4d4f-8a74-34764e2fdbd8', 'volume_size': 1, 'snapshot_id': '3abe6d24-2ffc-47ab-81cd-14c653bfc7c8'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe307d0-7dce-4544-ab80-93043665c67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe307d0-7dce-4544-ab80-93043665c67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4246e71e-d892-453b-9556-d550b84f9f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:33 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Volume 3af65988-992c-4d4f-8a74-34764e2fdbd8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3af65988-992c-4d4f-8a74-34764e2fdbd8', 'volume_size': 1, 'snapshot_id': '3abe6d24-2ffc-47ab-81cd-14c653bfc7c8'} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "cinder-ed537225-0acb-4562-8fa1-498abc1bda81-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" returned: 0 in 0.881s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddf4ba3e-3dcc-40c8-87ff-49b1b1f82748 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-c67c7a93-6121-49f0-b02e-2d6b41423994-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-ed537225-0acb-4562-8fa1-498abc1bda81-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:33 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f 1G Apr 24 19:28:33 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "cinder-quobyte-ed537225-0acb-4562-8fa1-498abc1bda81" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-quobyte-ed537225-0acb-4562-8fa1-498abc1bda81" acquired by "delete_volume" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0847f3a2-dd6f-48e4-8757-00d317da6de1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:33 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81 Apr 24 19:28:33 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:33 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f 1G" returned: 0 in 0.805s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:33 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f Apr 24 19:28:33 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:34 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81" returned: 0 in 0.807s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:34 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81 Apr 24 19:28:34 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:34 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ed537225-0acb-4562-8fa1-498abc1bda81" returned: 0 in 0.521s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-quobyte-ed537225-0acb-4562-8fa1-498abc1bda81" released by "delete_volume" :: held 1.380s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:34 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f" returned: 0 in 0.695s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:34 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f is being set with open permissions: ugo+rw Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:34 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f Apr 24 19:28:34 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Created reservations ['f58a0cc1-bbe2-441b-8bc3-97ac2947c4de', 'd955a80a-609b-4331-a4bc-f508e2e84ec1', '4db92ae2-382a-4386-935b-b04ade13227e', '0039b110-fe9e-4059-bff8-0c4757390cd5'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:34 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:34 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:35 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f" returned: 0 in 0.564s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:35 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.info Apr 24 19:28:35 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:35 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "cinder-19bad6b6-68c5-4424-9184-c84fe1081bf2-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.672s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:35 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Deleted volume successfully. Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-19bad6b6-68c5-4424-9184-c84fe1081bf2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-51d081ae-bcd0-4356-b31b-5bbfee7dbc1f tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-ed537225-0acb-4562-8fa1-498abc1bda81-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "cinder-quobyte-19bad6b6-68c5-4424-9184-c84fe1081bf2" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-quobyte-19bad6b6-68c5-4424-9184-c84fe1081bf2" acquired by "delete_volume" :: waited 0.044s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1975450-1cbe-4b56-96c7-0f0f8c823fb1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:35 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2 Apr 24 19:28:35 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:35 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.info" returned: 0 in 0.686s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:35 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.info is being set with open permissions: ugo+rw Apr 24 19:28:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:35 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.info Apr 24 19:28:35 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:36 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2" returned: 0 in 0.646s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:36 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2 Apr 24 19:28:36 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:36 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.info" returned: 0 in 0.577s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.410s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.399s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-quobyte-3abe6d24-2ffc-47ab-81cd-14c653bfc7c8-3af65988-992c-4d4f-8a74-34764e2fdbd8" by "_create_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:36 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3eae66cb-7208-4804-ad30-c9de61dc622d tempest-CreateVolumesFromSnapshotTest-1921026333 None] Create snapshot completed successfully Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-3abe6d24-2ffc-47ab-81cd-14c653bfc7c8-3af65988-992c-4d4f-8a74-34764e2fdbd8" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Creating volume 3af65988-992c-4d4f-8a74-34764e2fdbd8 from snapshot 3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 {{(pid=81943) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-quobyte-3af65988-992c-4d4f-8a74-34764e2fdbd8" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-3af65988-992c-4d4f-8a74-34764e2fdbd8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] snapshot: 3abe6d24-2ffc-47ab-81cd-14c653bfc7c8, volume: 3af65988-992c-4d4f-8a74-34764e2fdbd8, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[095a6cf2-5afc-4e51-86e2-53825d50cbb3]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:36 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 Apr 24 19:28:36 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:36 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19bad6b6-68c5-4424-9184-c84fe1081bf2" returned: 0 in 0.694s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-quobyte-19bad6b6-68c5-4424-9184-c84fe1081bf2" released by "delete_volume" :: held 1.393s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:36 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Created reservations ['020d3371-e0ac-488e-88ed-6c3118fd7485', '668d23de-93ee-48ed-8642-c62f5d2e19f7', 'c2a0058a-e205-48a4-9d95-0806e8e83c58', '5bdcfdc8-5ede-4b6f-96ad-a7cca17d62ce'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:37 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:37 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:37 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8" returned: 0 in 0.798s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e2548b8-ccb7-4254-a650-fba86554570d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf294de-0fc3-4abf-a18f-58835db56745]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:37 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d Apr 24 19:28:37 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:37 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.633s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:37 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Deleted volume successfully. Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "cinder-ec7ef061-972c-4dec-b7fc-79d9c2a9b482-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d3b3f0f1-6a77-4ca5-9c39-19b212160c59 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-19bad6b6-68c5-4424-9184-c84fe1081bf2-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-ec7ef061-972c-4dec-b7fc-79d9c2a9b482-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "cinder-quobyte-ec7ef061-972c-4dec-b7fc-79d9c2a9b482" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-quobyte-ec7ef061-972c-4dec-b7fc-79d9c2a9b482" acquired by "delete_volume" :: waited 0.016s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6c6d20-aa57-407a-901d-ab03ea7e038b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:38 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482 Apr 24 19:28:38 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (ca90dafb-7447-414e-9121-b69e3dd4499b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578d65e2-3469-4546-ab27-c0a6afef2608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578d65e2-3469-4546-ab27-c0a6afef2608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-816242323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d868655-3156-48ab-aafd-5cece80f1672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:38Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cbc567-5210-43af-9e13-de78b6740f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cbc567-5210-43af-9e13-de78b6740f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2538d5-ca1c-4370-a6cf-7787eec6c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2538d5-ca1c-4370-a6cf-7787eec6c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d868655-3156-48ab-aafd-5cece80f1672', 'volume_name': 'volume-1d868655-3156-48ab-aafd-5cece80f1672', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ad3338-665e-4c2d-b913-95c3b0ea1c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ad3338-665e-4c2d-b913-95c3b0ea1c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc33a8b0-bfe5-4a0e-adc3-0884a5d66136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:38 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume 1d868655-3156-48ab-aafd-5cece80f1672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d868655-3156-48ab-aafd-5cece80f1672', 'volume_size': 1} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:38 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d" returned: 0 in 1.090s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:38 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 Apr 24 19:28:38 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:38 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (58cdebf9-cc3f-4082-afa5-facefc95d36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfa0d7e-5d60-4063-8a75-ea9e18764f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482" returned: 0 in 0.863s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfa0d7e-5d60-4063-8a75-ea9e18764f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465817785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00ccbc9-3a3e-4143-9c72-548b7da207e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:39Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc7ccc6-41f0-45ca-996b-1515e6b24ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc7ccc6-41f0-45ca-996b-1515e6b24ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a6629b-7c9a-48bc-9a6c-3b010758522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a6629b-7c9a-48bc-9a6c-3b010758522f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00ccbc9-3a3e-4143-9c72-548b7da207e4', 'volume_name': 'volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fc7a05-c1b1-41e8-b22b-d0ed814db3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:38 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482 Apr 24 19:28:38 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fc7a05-c1b1-41e8-b22b-d0ed814db3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc08875a-6bfb-4787-b44a-059f97e72411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:38 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume c00ccbc9-3a3e-4143-9c72-548b7da207e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4', 'volume_size': 1} Apr 24 19:28:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (71e54379-850b-400e-b369-068431bc0316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105db7f6-55e4-4085-964f-ecb68f51c8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105db7f6-55e4-4085-964f-ecb68f51c8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1231547287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e5906a-8c50-4ce2-93c0-8453305c6738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:39Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0676b8cc-2c83-4b3a-84bf-899938b96f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0676b8cc-2c83-4b3a-84bf-899938b96f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac385ceb-6930-42a9-94bf-70df5c1258e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac385ceb-6930-42a9-94bf-70df5c1258e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e5906a-8c50-4ce2-93c0-8453305c6738', 'volume_name': 'volume-d6e5906a-8c50-4ce2-93c0-8453305c6738', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882b92cb-6edd-4c61-aa07-ca7c08932e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882b92cb-6edd-4c61-aa07-ca7c08932e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3ed2e4-1db3-4d09-995d-9c870f729eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:39 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume d6e5906a-8c50-4ce2-93c0-8453305c6738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e5906a-8c50-4ce2-93c0-8453305c6738', 'volume_size': 1} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:39 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ec7ef061-972c-4dec-b7fc-79d9c2a9b482" returned: 0 in 0.993s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-quobyte-ec7ef061-972c-4dec-b7fc-79d9c2a9b482" released by "delete_volume" :: held 1.931s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Created reservations ['612f750b-dd0f-4f3e-9a05-733533e770e2', '54a95e18-5994-4405-8882-e10132ec9fae', '104a51c2-293e-41d8-ab5a-3ae7e5c8d9c4', 'b33265bb-6989-45c4-ada6-56383d3407dc'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:39 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (1ed39b06-44f3-4220-9451-5a5038d87447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93155d2a-d5f2-474f-ba63-966e61d60c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93155d2a-d5f2-474f-ba63-966e61d60c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323119472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aadcdd2-4506-4fd6-8708-b3b4b761c06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:40Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8b010a-2e81-4c53-96f0-2c6a35a79c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8b010a-2e81-4c53-96f0-2c6a35a79c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afaf75c3-936b-4e7a-869a-70791dd456b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afaf75c3-936b-4e7a-869a-70791dd456b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aadcdd2-4506-4fd6-8708-b3b4b761c06d', 'volume_name': 'volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119032b9-a833-4b2b-bf44-129c382e8d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119032b9-a833-4b2b-bf44-129c382e8d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567260d0-de62-411e-ada5-83da32a6acd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:40 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume 6aadcdd2-4506-4fd6-8708-b3b4b761c06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d', 'volume_size': 1} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:40 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:40 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:40 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:40 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (6d6e4c20-c51b-47a3-bc1c-6dbfeb3bd0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f512a1-8a4f-40a6-8ea6-12c000ea65da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f512a1-8a4f-40a6-8ea6-12c000ea65da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1207569614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca602c49-7bc4-4d9b-ac9f-ee661d23e251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:41Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b52ac6d-1df0-4db1-a9c4-ffb76d8456ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b52ac6d-1df0-4db1-a9c4-ffb76d8456ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f014ad24-56e1-4f27-8042-75b046f2974b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f014ad24-56e1-4f27-8042-75b046f2974b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca602c49-7bc4-4d9b-ac9f-ee661d23e251', 'volume_name': 'volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed8ff51-914b-4ba8-bedd-3b17583dad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed8ff51-914b-4ba8-bedd-3b17583dad2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac841e08-a8f8-414d-ba75-467f53373b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:41 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume ca602c49-7bc4-4d9b-ac9f-ee661d23e251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251', 'volume_size': 1} Apr 24 19:28:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:42 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 2.164s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:42 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Deleted volume successfully. Apr 24 19:28:42 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.617s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4685252f-f3f6-454c-a573-f896aa115e78 tempest-CreateVolumesFromImageTest-1664180045 None] Lock "cinder-ec7ef061-972c-4dec-b7fc-79d9c2a9b482-delete_volume" released by "delete_volume" :: held 4.807s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Flow 'volume_create_manager' (df321426-c205-4d7b-8da2-aeba2a64425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d670f02e-5048-470e-8f8b-cc8457e76956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d670f02e-5048-470e-8f8b-cc8457e76956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2039795377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3674aff-7218-48f9-a18f-e472983ef6e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fc6d93180440e9b3663eed7eeeeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:44Z,use_quota=True,user_id='243254eaccec4e3582e4c76601b6f25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d996e8ea-05c7-4aac-9542-71c09a0bb8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d996e8ea-05c7-4aac-9542-71c09a0bb8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e379dc6-6bb0-4ac2-9ba1-b37520839b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e379dc6-6bb0-4ac2-9ba1-b37520839b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3674aff-7218-48f9-a18f-e472983ef6e4', 'volume_name': 'volume-d3674aff-7218-48f9-a18f-e472983ef6e4', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e6d334-4bc1-422d-98c8-a385ec578028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e6d334-4bc1-422d-98c8-a385ec578028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2b084a-e15c-4183-bf0d-c198a8acfe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:44 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Volume d3674aff-7218-48f9-a18f-e472983ef6e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3674aff-7218-48f9-a18f-e472983ef6e4', 'volume_size': 1} Apr 24 19:28:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:45 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8" returned: 0 in 7.058s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:45 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e0db2-c16a-48dc-ba8d-e52a9434d754]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:45 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d Apr 24 19:28:45 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:46 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d" returned: 0 in 0.763s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:28:46 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Converted 1024.00 MB image at 145.04 MB/s Apr 24 19:28:46 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 is being set with open permissions: ugo+rw Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:46 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 Apr 24 19:28:46 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Flow 'volume_create_manager' (545576ec-d118-448f-8099-1418727ce752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d8b370-1ad0-44c1-a1e3-9e4ab30efcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d8b370-1ad0-44c1-a1e3-9e4ab30efcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6da29ff05ba44cea76eed24a21203b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:46Z,use_quota=True,user_id='c63de69d7e5842f398c5529623709b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c97067-a3ca-4d70-b1f6-74fe89b6c353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c97067-a3ca-4d70-b1f6-74fe89b6c353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06614f6b-a2d7-4156-9a5c-4ad33b4e8fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06614f6b-a2d7-4156-9a5c-4ad33b4e8fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf', 'volume_name': 'volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ae07ee-c2fa-4d02-b99b-5101e6a56451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ae07ee-c2fa-4d02-b99b-5101e6a56451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827bb38a-7659-44d4-822a-ad58d429988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:46 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Volume 19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf', 'volume_size': 1} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:46 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8" returned: 0 in 0.502s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-3af65988-992c-4d4f-8a74-34764e2fdbd8" released by "_copy_volume_from_snapshot" :: held 10.315s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-3abe6d24-2ffc-47ab-81cd-14c653bfc7c8-3af65988-992c-4d4f-8a74-34764e2fdbd8" released by "_create_volume_from_snapshot" :: held 10.359s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.415s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.528s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-816242323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d868655-3156-48ab-aafd-5cece80f1672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:38Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Creating volume 1d868655-3156-48ab-aafd-5cece80f1672 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:46 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:46 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672 1073741824 Apr 24 19:28:46 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4246e71e-d892-453b-9556-d550b84f9f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af65988-992c-4d4f-8a74-34764e2fdbd8', 'volume_size': 1, 'snapshot_id': '3abe6d24-2ffc-47ab-81cd-14c653bfc7c8'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fde1b1-cd0d-4bcc-aa3b-e5f1b0ef6e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:47 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Volume volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 (3af65988-992c-4d4f-8a74-34764e2fdbd8): created successfully Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fde1b1-cd0d-4bcc-aa3b-e5f1b0ef6e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Flow 'volume_create_manager' (91158905-79de-4958-8a74-5933ad0592d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:47 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-4d098134-be02-4895-89e9-d381a72310fb tempest-VolumeDependencyTests-154960378 None] Created volume successfully. Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-3abe6d24-2ffc-47ab-81cd-14c653bfc7c8-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Lock "cinder-3abe6d24-2ffc-47ab-81cd-14c653bfc7c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-quobyte-2e2548b8-ccb7-4254-a650-fba86554570d" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-2e2548b8-ccb7-4254-a650-fba86554570d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-quobyte-3abe6d24-2ffc-47ab-81cd-14c653bfc7c8" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-3abe6d24-2ffc-47ab-81cd-14c653bfc7c8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Deleting offline snapshot 3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 of volume 2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] snapshot_file for this snap is: volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[353bb5c1-1933-4e50-8119-62767983b225]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:47 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 Apr 24 19:28:47 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:47 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672 1073741824" returned: 0 in 0.746s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:47 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672 Apr 24 19:28:47 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:48 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8" returned: 0 in 0.552s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e2548b8-ccb7-4254-a650-fba86554570d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45bd9f0-12a1-43ac-a8b1-0c49f29afa49]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:48 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672" returned: 0 in 0.485s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.411s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465817785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00ccbc9-3a3e-4143-9c72-548b7da207e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:39Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Creating volume c00ccbc9-3a3e-4143-9c72-548b7da207e4 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:48 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:48 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d Apr 24 19:28:48 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc33a8b0-bfe5-4a0e-adc3-0884a5d66136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d868655-3156-48ab-aafd-5cece80f1672', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d80a90-c892-4d78-a92b-951018908e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:48 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4 1073741824 Apr 24 19:28:48 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:48 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume volume-1d868655-3156-48ab-aafd-5cece80f1672 (1d868655-3156-48ab-aafd-5cece80f1672): created successfully Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d80a90-c892-4d78-a92b-951018908e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (ca90dafb-7447-414e-9121-b69e3dd4499b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:48 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-dceecd34-3ed2-4b99-a6dc-892b59d6dd18 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created volume successfully. Apr 24 19:28:48 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d" returned: 0 in 0.554s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:48 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 Apr 24 19:28:48 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:48 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4 1073741824" returned: 0 in 0.701s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:48 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4 Apr 24 19:28:48 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:49 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8" returned: 0 in 0.585s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:49 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8 Apr 24 19:28:49 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:49 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4" returned: 0 in 0.472s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.181s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1231547287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e5906a-8c50-4ce2-93c0-8453305c6738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:39Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Creating volume d6e5906a-8c50-4ce2-93c0-8453305c6738 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:49 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc08875a-6bfb-4787-b44a-059f97e72411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:49 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738 1073741824 Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2622f9-12b2-433c-a860-d9033aeb2e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:49 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:49 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4 (c00ccbc9-3a3e-4143-9c72-548b7da207e4): created successfully Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2622f9-12b2-433c-a860-d9033aeb2e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (58cdebf9-cc3f-4082-afa5-facefc95d36f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9b26b833-37db-4a7f-917a-6f1c65aff720 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created volume successfully. Apr 24 19:28:49 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d.3abe6d24-2ffc-47ab-81cd-14c653bfc7c8" returned: 0 in 0.469s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-3abe6d24-2ffc-47ab-81cd-14c653bfc7c8" released by "_delete_snapshot" :: held 2.275s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-2e2548b8-ccb7-4254-a650-fba86554570d" released by "delete_snapshot" :: held 2.306s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Created reservations ['99d12ede-70b1-47c8-9d9f-a1daa96fc736', 'f6821d8c-793a-426b-bcf1-c5177e0fac06', 'ccc24771-ec0f-421b-a712-5ae2fa405e11', '21b8fe4d-03af-488a-b467-0818623705f5'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Delete snapshot completed successfully. Apr 24 19:28:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-01d855be-cc8c-44d2-a0b0-9882ce15cb2c tempest-VolumeDependencyTests-154960378 None] Lock "cinder-3abe6d24-2ffc-47ab-81cd-14c653bfc7c8-delete_snapshot" released by "delete_snapshot" :: held 2.481s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:50 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738 1073741824" returned: 0 in 0.700s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:50 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738 Apr 24 19:28:50 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:50 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738" returned: 0 in 0.456s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.354s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323119472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aadcdd2-4506-4fd6-8708-b3b4b761c06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:40Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Creating volume 6aadcdd2-4506-4fd6-8708-b3b4b761c06d {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:50 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-2e2548b8-ccb7-4254-a650-fba86554570d-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:50 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d 1073741824 Apr 24 19:28:50 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3ed2e4-1db3-4d09-995d-9c870f729eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e5906a-8c50-4ce2-93c0-8453305c6738', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f61377-4419-407c-ba66-52456be9784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:50 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume volume-d6e5906a-8c50-4ce2-93c0-8453305c6738 (d6e5906a-8c50-4ce2-93c0-8453305c6738): created successfully Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f61377-4419-407c-ba66-52456be9784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (71e54379-850b-400e-b369-068431bc0316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Lock "cinder-2e2548b8-ccb7-4254-a650-fba86554570d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:50 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-ca458739-6394-431b-9246-12f746a8a453 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created volume successfully. Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-quobyte-2e2548b8-ccb7-4254-a650-fba86554570d" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-2e2548b8-ccb7-4254-a650-fba86554570d" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ad8510-7531-449b-8df6-b25f76f1336b]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:50 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d Apr 24 19:28:50 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:51 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d 1073741824" returned: 0 in 0.688s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:51 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d Apr 24 19:28:51 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:51 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d" returned: 0 in 0.640s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:51 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d Apr 24 19:28:51 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:51 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d" returned: 0 in 0.538s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.398s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1207569614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca602c49-7bc4-4d9b-ac9f-ee661d23e251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d58e81b30642199394f3c61f55cc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:41Z,use_quota=True,user_id='152f6709e40b4e338b89a06756502f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:51 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Creating volume ca602c49-7bc4-4d9b-ac9f-ee661d23e251 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:51 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-2e2548b8-ccb7-4254-a650-fba86554570d" returned: 0 in 0.476s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:51 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251 1073741824 Apr 24 19:28:51 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-2e2548b8-ccb7-4254-a650-fba86554570d" released by "delete_volume" :: held 1.180s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567260d0-de62-411e-ada5-83da32a6acd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252ee1d5-436e-4dfb-a8a2-d54a42759963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:UPDATE=133,cinder:DELETE=19,cinder:SELECT=91,cinder:INSERT=33 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:28:51 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d (6aadcdd2-4506-4fd6-8708-b3b4b761c06d): created successfully Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252ee1d5-436e-4dfb-a8a2-d54a42759963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:51 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (1ed39b06-44f3-4220-9451-5a5038d87447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-7c13cb09-8fba-467a-8a22-2ad9e09a18b8 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created volume successfully. Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Created reservations ['47b11581-43e3-41c1-8e53-8b42ead8d4fe', 'e1397a17-1590-478a-9c60-1103e4ffd007', 'a1047ce2-0e37-4d20-a610-288fd09cb542', '327dfbb5-a657-4a4d-b444-d5ae9037afaf'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:52 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:52 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:52 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:52 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.507s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251 1073741824" returned: 0 in 0.710s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:52 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Deleted volume successfully. Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-82452829-7d9e-490f-8054-59d3d5d2471b tempest-VolumeDependencyTests-154960378 None] Lock "cinder-2e2548b8-ccb7-4254-a650-fba86554570d-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:52 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:52 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251 Apr 24 19:28:52 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:53 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251" returned: 0 in 0.470s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.833s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2039795377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3674aff-7218-48f9-a18f-e472983ef6e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fc6d93180440e9b3663eed7eeeeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:44Z,use_quota=True,user_id='243254eaccec4e3582e4c76601b6f25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Creating volume d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:53 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:53 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 1073741824 Apr 24 19:28:53 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac841e08-a8f8-414d-ba75-467f53373b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ab7815-345a-49c3-b66c-0af6246b81ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:53 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Volume volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251 (ca602c49-7bc4-4d9b-ac9f-ee661d23e251): created successfully Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ab7815-345a-49c3-b66c-0af6246b81ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Flow 'volume_create_manager' (6d6e4c20-c51b-47a3-bc1c-6dbfeb3bd0c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:53 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-a286fc93-470c-4e18-bb30-5660c6326e1a tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created volume successfully. Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Flow 'volume_create_manager' (92378e70-84e0-4910-ac71-545dc6687f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e48212-8ce1-4251-9ea5-3ed7ae7f3341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e48212-8ce1-4251-9ea5-3ed7ae7f3341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1305405340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707f34fa-042f-41a5-8588-728357bc68bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9e81f42985488b855ef40ff0c84ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:53Z,use_quota=True,user_id='e2164092bcc844bba2653b7611ac7348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820e6d83-6f17-47c3-8d1e-1b01c59375a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820e6d83-6f17-47c3-8d1e-1b01c59375a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150407dd-4a01-4daa-8f07-2306686ab232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150407dd-4a01-4daa-8f07-2306686ab232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707f34fa-042f-41a5-8588-728357bc68bd', 'volume_name': 'volume-707f34fa-042f-41a5-8588-728357bc68bd', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade6d23d-a534-4d85-b879-88f6b2eb4a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade6d23d-a534-4d85-b879-88f6b2eb4a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296b2bed-476b-41d3-861a-0fedbfc7986e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:53 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Volume 707f34fa-042f-41a5-8588-728357bc68bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707f34fa-042f-41a5-8588-728357bc68bd', 'volume_size': 1} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-ca602c49-7bc4-4d9b-ac9f-ee661d23e251-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-ca602c49-7bc4-4d9b-ac9f-ee661d23e251-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-quobyte-ca602c49-7bc4-4d9b-ac9f-ee661d23e251" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-ca602c49-7bc4-4d9b-ac9f-ee661d23e251" acquired by "delete_volume" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0a0e25-2e46-47cc-919d-2813ba1732f9]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:53 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251 Apr 24 19:28:53 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:53 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 1073741824" returned: 0 in 0.698s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:53 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:53 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 Apr 24 19:28:53 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:54 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251" returned: 0 in 0.616s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:54 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251 Apr 24 19:28:54 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:54 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4" returned: 0 in 0.471s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.862s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6da29ff05ba44cea76eed24a21203b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:46Z,use_quota=True,user_id='c63de69d7e5842f398c5529623709b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Creating volume 19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:54 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2b084a-e15c-4183-bf0d-c198a8acfe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3674aff-7218-48f9-a18f-e472983ef6e4', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5115e07a-4568-41a6-99f9-132fdf4e13f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:54 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Volume volume-d3674aff-7218-48f9-a18f-e472983ef6e4 (d3674aff-7218-48f9-a18f-e472983ef6e4): created successfully Apr 24 19:28:54 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf 1073741824 Apr 24 19:28:54 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5115e07a-4568-41a6-99f9-132fdf4e13f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Flow 'volume_create_manager' (df321426-c205-4d7b-8da2-aeba2a64425c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:54 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-5b7c4db9-fba6-4a60-8749-131dccfb3be4 tempest-SnapshotDependencyTests-122296236 None] Created volume successfully. Apr 24 19:28:54 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ca602c49-7bc4-4d9b-ac9f-ee661d23e251" returned: 0 in 0.485s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-ca602c49-7bc4-4d9b-ac9f-ee661d23e251" released by "delete_volume" :: held 1.142s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created reservations ['709e81d0-0130-4a58-b266-41ed75e286a6', 'f4ef6130-8a26-4569-be8d-840f99fdca48', '64c9c9b5-690f-427f-ad09-2665f6e49e64', '8a5be24b-f862-48aa-9a7a-350e48b11dfe'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:54 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:54 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:54 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:55 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf 1073741824" returned: 0 in 0.739s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:55 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf Apr 24 19:28:55 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:55 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.567s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:55 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Deleted volume successfully. Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-c7a56a6b-0c4a-4ad2-8847-c585a2595fe3 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-ca602c49-7bc4-4d9b-ac9f-ee661d23e251-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-6aadcdd2-4506-4fd6-8708-b3b4b761c06d-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-6aadcdd2-4506-4fd6-8708-b3b4b761c06d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-quobyte-6aadcdd2-4506-4fd6-8708-b3b4b761c06d" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:55 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf" returned: 0 in 0.503s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-6aadcdd2-4506-4fd6-8708-b3b4b761c06d" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.311s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1305405340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707f34fa-042f-41a5-8588-728357bc68bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9e81f42985488b855ef40ff0c84ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:53Z,use_quota=True,user_id='e2164092bcc844bba2653b7611ac7348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Creating volume 707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:28:55 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ae367-25a2-489a-87cf-40dddeaaba73]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:55 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd 1073741824 Apr 24 19:28:55 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827bb38a-7659-44d4-822a-ad58d429988e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ad5e12-b7c4-4d3c-9218-a729f65175e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:55 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Volume volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf (19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf): created successfully Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ad5e12-b7c4-4d3c-9218-a729f65175e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:55 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Flow 'volume_create_manager' (545576ec-d118-448f-8099-1418727ce752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:55 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-f228616e-2a3f-4b3b-82ee-f48b16db6e77 tempest-CinderUnicodeTest-711234343 None] Created volume successfully. Apr 24 19:28:55 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d Apr 24 19:28:55 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:56 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d" returned: 0 in 0.640s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:56 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d Apr 24 19:28:56 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:56 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd 1073741824" returned: 0 in 0.748s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:56 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd Apr 24 19:28:56 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Flow 'volume_create_manager' (6d691eb4-7f76-4682-8ea9-bc589a0c07ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c04f54-4a0e-4f33-81c1-573175d30a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c04f54-4a0e-4f33-81c1-573175d30a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-738897659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03494d0-f3ba-4922-a9c5-7ece8e06bead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6da29ff05ba44cea76eed24a21203b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:56Z,use_quota=True,user_id='c63de69d7e5842f398c5529623709b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691ff9a1-e98f-4197-bbcf-713c87c853de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691ff9a1-e98f-4197-bbcf-713c87c853de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e7981d-fdfe-4eac-a069-251d5a231299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e7981d-fdfe-4eac-a069-251d5a231299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03494d0-f3ba-4922-a9c5-7ece8e06bead', 'volume_name': 'volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335d6342-fcc6-4c60-aaf0-afda20319db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335d6342-fcc6-4c60-aaf0-afda20319db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58dd2c57-94c4-44cb-b4e2-fa02ef7c5fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:56 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Volume f03494d0-f3ba-4922-a9c5-7ece8e06bead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead', 'volume_size': 1} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:56 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-6aadcdd2-4506-4fd6-8708-b3b4b761c06d" returned: 0 in 0.542s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-6aadcdd2-4506-4fd6-8708-b3b4b761c06d" released by "delete_volume" :: held 1.240s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:56 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created reservations ['c713daa5-a2b5-4ecc-acfb-e43455e94cce', 'f72d65ac-37c0-4342-8c1a-2c98497daf5f', 'b7e5f849-21c7-41df-8511-2f3bf20ad16f', '4addecab-7a37-4e20-8d2f-c55f551f1070'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd" returned: 0 in 0.496s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:28:56 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.951s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296b2bed-476b-41d3-861a-0fedbfc7986e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707f34fa-042f-41a5-8588-728357bc68bd', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188f8b77-f8b9-4bc7-a646-b044822f76b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Creating offline snapshot b8b6fabd-3ce4-42b4-9995-d16a557b147d of volume d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6eebce-7124-4849-a600-f516b8bc09e5]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:57 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Volume volume-707f34fa-042f-41a5-8588-728357bc68bd (707f34fa-042f-41a5-8588-728357bc68bd): created successfully Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188f8b77-f8b9-4bc7-a646-b044822f76b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Flow 'volume_create_manager' (92378e70-84e0-4910-ac71-545dc6687f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:57 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-62e0b77d-9a36-47f5-8eb4-7a172923a7de tempest-VolumeDependencyTests-154960378 None] Created volume successfully. Apr 24 19:28:57 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 Apr 24 19:28:57 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:57 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:57 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:57 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4" returned: 0 in 0.580s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:57 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d 1G Apr 24 19:28:57 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:57 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.523s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:57 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Deleted volume successfully. Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2590df13-eaea-4899-a24f-630c4f498aef tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-6aadcdd2-4506-4fd6-8708-b3b4b761c06d-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-d6e5906a-8c50-4ce2-93c0-8453305c6738-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-d6e5906a-8c50-4ce2-93c0-8453305c6738-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-quobyte-d6e5906a-8c50-4ce2-93c0-8453305c6738" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-d6e5906a-8c50-4ce2-93c0-8453305c6738" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a0350a-7652-4dca-aedc-ea487180ad12]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:28:57 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:28:58 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738 Apr 24 19:28:58 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Flow 'volume_create_manager' (2dd8ad8b-a46a-4c34-8876-63fd71287e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b9e628-9059-4b38-b2b0-f7bd04056588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b9e628-9059-4b38-b2b0-f7bd04056588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1669229391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc444fb-24b7-4edd-99f8-f75aa759de1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9e81f42985488b855ef40ff0c84ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=707f34fa-042f-41a5-8588-728357bc68bd,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:58Z,use_quota=True,user_id='e2164092bcc844bba2653b7611ac7348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f521d7b-b773-4d28-8683-694dcb5812a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f521d7b-b773-4d28-8683-694dcb5812a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada6d6d5-e96b-427d-93a7-9bdeeddaa023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada6d6d5-e96b-427d-93a7-9bdeeddaa023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ffc444fb-24b7-4edd-99f8-f75aa759de1c', 'volume_name': 'volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c', 'volume_size': 1, 'source_volid': '707f34fa-042f-41a5-8588-728357bc68bd', 'source_volstatus': 'available'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02afb2f-61dc-42d5-a6a1-a97b10f3ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02afb2f-61dc-42d5-a6a1-a97b10f3ce97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ee4c90-e7ca-4aa1-b821-00c4573379eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:28:58 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Volume ffc444fb-24b7-4edd-99f8-f75aa759de1c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c', 'volume_size': 1, 'source_volid': '707f34fa-042f-41a5-8588-728357bc68bd', 'source_volstatus': 'available'} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:58 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d 1G" returned: 0 in 0.767s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3674aff-7218-48f9-a18f-e472983ef6e4 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:58 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3674aff-7218-48f9-a18f-e472983ef6e4 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d Apr 24 19:28:58 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:58 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738" returned: 0 in 0.619s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:58 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738 Apr 24 19:28:58 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:58 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3674aff-7218-48f9-a18f-e472983ef6e4 -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d" returned: 0 in 0.550s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:58 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d is being set with open permissions: ugo+rw Apr 24 19:28:58 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:59 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d Apr 24 19:28:59 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:59 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d6e5906a-8c50-4ce2-93c0-8453305c6738" returned: 0 in 0.513s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-d6e5906a-8c50-4ce2-93c0-8453305c6738" released by "delete_volume" :: held 1.191s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created reservations ['75aafbc4-c62f-4ebd-a90e-874ee683fbd3', '13e2c528-9fca-403e-9db9-e1666c27bfd9', 'c1063273-f6fe-45a6-b4d2-f976c1e6c997', '3a3391e4-eaf0-47fc-b960-390f00d0aa83'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:59 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:28:59 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:59 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d" returned: 0 in 0.523s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:28:59 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.info Apr 24 19:28:59 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:28:59 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.460s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:28:59 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Deleted volume successfully. Apr 24 19:28:59 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-bdfbfcdf-289c-46cf-8480-8df9c5274c53 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-d6e5906a-8c50-4ce2-93c0-8453305c6738-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:00 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.info" returned: 0 in 0.516s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:00 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.info is being set with open permissions: ugo+rw Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:00 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.info Apr 24 19:29:00 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-c00ccbc9-3a3e-4143-9c72-548b7da207e4-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-c00ccbc9-3a3e-4143-9c72-548b7da207e4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-quobyte-c00ccbc9-3a3e-4143-9c72-548b7da207e4" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-c00ccbc9-3a3e-4143-9c72-548b7da207e4" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a00b48e-60e2-4f44-9179-3c3d85bb6cfd]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:00 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4 Apr 24 19:29:00 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:00 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.info" returned: 0 in 0.488s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.541s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.934s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:28:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-738897659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03494d0-f3ba-4922-a9c5-7ece8e06bead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6da29ff05ba44cea76eed24a21203b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:28:56Z,use_quota=True,user_id='c63de69d7e5842f398c5529623709b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Creating volume f03494d0-f3ba-4922-a9c5-7ece8e06bead {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:29:00 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:00 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead 1073741824 Apr 24 19:29:00 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:00 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-823eaa04-f256-433e-9095-c17dc49498fb tempest-SnapshotDependencyTests-122296236 None] Create snapshot completed successfully Apr 24 19:29:00 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4" returned: 0 in 0.574s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:00 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:00 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4 Apr 24 19:29:00 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:01 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead 1073741824" returned: 0 in 0.700s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:01 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-c00ccbc9-3a3e-4143-9c72-548b7da207e4" returned: 0 in 0.534s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:01 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead Apr 24 19:29:01 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-c00ccbc9-3a3e-4143-9c72-548b7da207e4" released by "delete_volume" :: held 1.159s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created reservations ['af611401-4025-46a0-a215-c07703c1a080', '7ba12328-589a-4f62-a9b1-17920291cd01', '7abc034c-89e5-4788-9ba7-d10e11afa1f6', '544fe2d5-7572-4967-8abb-43c2a2b423ef'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:01 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:01 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Flow 'volume_create_manager' (d21e712f-8e95-451d-8524-16b220a3a498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1693c81-4d17-46f0-ae7f-055c8f5a099b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1693c81-4d17-46f0-ae7f-055c8f5a099b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf18da2-34d1-4c6e-a873-bd94601b9093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fc6d93180440e9b3663eed7eeeeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8b6fabd-3ce4-42b4-9995-d16a557b147d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:02Z,use_quota=True,user_id='243254eaccec4e3582e4c76601b6f25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8669445-04c9-4ea2-aa30-805f7f2005be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8669445-04c9-4ea2-aa30-805f7f2005be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:01 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eccc18b-09e6-476e-b1a0-fd3f532a04ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eccc18b-09e6-476e-b1a0-fd3f532a04ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'adf18da2-34d1-4c6e-a873-bd94601b9093', 'volume_name': 'volume-adf18da2-34d1-4c6e-a873-bd94601b9093', 'volume_size': 1, 'snapshot_id': 'b8b6fabd-3ce4-42b4-9995-d16a557b147d'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c35b676-ba8c-42ac-b45b-86ee42ae3cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c35b676-ba8c-42ac-b45b-86ee42ae3cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e71193-881c-4524-ae4a-eb33390037c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:01 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Volume adf18da2-34d1-4c6e-a873-bd94601b9093: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-adf18da2-34d1-4c6e-a873-bd94601b9093', 'volume_size': 1, 'snapshot_id': 'b8b6fabd-3ce4-42b4-9995-d16a557b147d'} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead" returned: 0 in 0.614s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.789s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:01 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Cloning volume 707f34fa-042f-41a5-8588-728357bc68bd to volume ffc444fb-24b7-4edd-99f8-f75aa759de1c Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58dd2c57-94c4-44cb-b4e2-fa02ef7c5fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec5cd50-5007-4e65-aeec-4244ff0df7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:01 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Creating offline snapshot 117b57f1-54c1-4f9a-a4e7-a474289a5281 of volume 707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:29:01 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Volume volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead (f03494d0-f3ba-4922-a9c5-7ece8e06bead): created successfully Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec5cd50-5007-4e65-aeec-4244ff0df7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Flow 'volume_create_manager' (6d691eb4-7f76-4682-8ea9-bc589a0c07ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[989aee19-2eca-4318-bc04-ead42a3989fc]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:02 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.571s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:02 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Deleted volume successfully. Apr 24 19:29:02 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-0c974d20-328b-464b-a42c-cc3c5ae3bff3 tempest-CinderUnicodeTest-711234343 None] Created volume successfully. Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-d74d3d50-6da5-48f4-9e98-e18860b12258 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-c00ccbc9-3a3e-4143-9c72-548b7da207e4-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:02 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd Apr 24 19:29:02 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-1d868655-3156-48ab-aafd-5cece80f1672-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-1d868655-3156-48ab-aafd-5cece80f1672-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-quobyte-1d868655-3156-48ab-aafd-5cece80f1672" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-1d868655-3156-48ab-aafd-5cece80f1672" acquired by "delete_volume" :: waited 0.014s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25f5afd-14a2-491e-805d-c0391d72295e]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:02 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672 Apr 24 19:29:02 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:02 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd" returned: 0 in 0.640s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:02 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 1G Apr 24 19:29:02 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:02 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672" returned: 0 in 0.565s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:02 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:03 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672 Apr 24 19:29:03 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:03 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 1G" returned: 0 in 0.712s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707f34fa-042f-41a5-8588-728357bc68bd -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:03 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707f34fa-042f-41a5-8588-728357bc68bd -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 Apr 24 19:29:03 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:03 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-1d868655-3156-48ab-aafd-5cece80f1672" returned: 0 in 0.535s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-1d868655-3156-48ab-aafd-5cece80f1672" released by "delete_volume" :: held 1.157s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created reservations ['8665bb1b-c95c-4c63-8131-dfb7a294dfe6', '70f09ca6-cf5f-4c4c-9d21-73cb5e214d79', '8594d57c-53ae-44c0-89b8-1ce400adf564', 'e881df87-4ef8-44e1-9664-981b58e1d2ab'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:03 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:03 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:03 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707f34fa-042f-41a5-8588-728357bc68bd -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281" returned: 0 in 0.523s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:03 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 is being set with open permissions: ugo+rw Apr 24 19:29:03 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:03 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 Apr 24 19:29:03 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:04 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.476s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:04 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Deleted volume successfully. Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-38a58133-7149-4b4a-a670-dc0d61fa5646 tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-1d868655-3156-48ab-aafd-5cece80f1672-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:04 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281" returned: 0 in 0.453s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:04 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.info Apr 24 19:29:04 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-b1e1aa17-7f6a-41bf-954a-5effbeb0924f-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-b1e1aa17-7f6a-41bf-954a-5effbeb0924f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-quobyte-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-quobyte-b1e1aa17-7f6a-41bf-954a-5effbeb0924f" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-b1e1aa17-7f6a-41bf-954a-5effbeb0924f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Deleting offline snapshot b1e1aa17-7f6a-41bf-954a-5effbeb0924f of volume 0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] snapshot_file for this snap is: volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d2eb5f-b726-4800-8684-48cb24d97274]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:04 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f Apr 24 19:29:04 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:04 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.info" returned: 0 in 0.521s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:04 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.info is being set with open permissions: ugo+rw Apr 24 19:29:04 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:04 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.info Apr 24 19:29:04 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:05 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f" returned: 0 in 0.571s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc76776-309e-48dd-98a4-04a4a69900d0]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:05 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f Apr 24 19:29:05 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:05 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.info" returned: 0 in 0.469s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-quobyte-ffc444fb-24b7-4edd-99f8-f75aa759de1c" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-ffc444fb-24b7-4edd-99f8-f75aa759de1c" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] snapshot: 117b57f1-54c1-4f9a-a4e7-a474289a5281, volume: ffc444fb-24b7-4edd-99f8-f75aa759de1c, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd7423b-4db9-4927-9fe9-81b299241a16]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:05 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 Apr 24 19:29:05 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:05 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" returned: 0 in 0.559s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:05 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f Apr 24 19:29:05 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:05 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281" returned: 0 in 0.520s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-707f34fa-042f-41a5-8588-728357bc68bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11771b7-2c50-4a16-9d03-0a746394755c]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:05 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:06 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd Apr 24 19:29:06 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:06 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f" returned: 0 in 0.589s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:06 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f Apr 24 19:29:06 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:06 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd" returned: 0 in 0.575s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:06 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:29:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:06 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c Apr 24 19:29:06 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:06 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:06 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f.b1e1aa17-7f6a-41bf-954a-5effbeb0924f" returned: 0 in 0.538s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-b1e1aa17-7f6a-41bf-954a-5effbeb0924f" released by "_delete_snapshot" :: held 2.379s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" released by "delete_snapshot" :: held 2.406s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:07 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created reservations ['e12abbe6-ccb6-469f-8bfd-3f61bbb4b4ae', 'd79d7026-79f4-414a-a889-25ff0cd542eb', '030120fd-784a-43f1-bf4b-4da5f31c367b', 'b7472021-6957-4df0-87f0-5bf70e53a0e8'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:07 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Delete snapshot completed successfully. Apr 24 19:29:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-dd8bd754-e76d-41b3-9b98-457108dfc2aa tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-b1e1aa17-7f6a-41bf-954a-5effbeb0924f-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "cinder-quobyte-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:07 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" acquired by "delete_volume" :: waited 0.027s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:08 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a18158d-60b9-4f4f-be6c-8616399a2cef]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:08 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:08 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f Apr 24 19:29:08 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:09 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" returned: 0 in 1.053s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:09 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:09 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f Apr 24 19:29:09 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:10 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" returned: 0 in 1.551s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:10 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-quobyte-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f" released by "delete_volume" :: held 2.750s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:10 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Created reservations ['84b7ba52-4503-4685-a402-72ae8cdf9b95', 'bbce826c-ba0c-4b79-89aa-f2c8840dde17', '0bedf03f-f173-48d6-8e6e-dd111ee4ec4f', 'ab24901f-16f1-4bd5-abdf-247024d96647'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:10 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:10 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:11 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:11 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:12 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 1.145s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:12 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:12 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Deleted volume successfully. Apr 24 19:29:12 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-3b619da7-0ca9-4e58-9185-0592384b3a0b tempest-CreateVolumesFromSnapshotTest-1921026333 None] Lock "cinder-0bec5807-bff3-4fa1-a3dc-24ab03cdfb3f-delete_volume" released by "delete_volume" :: held 4.280s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:12 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c" returned: 0 in 5.628s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:12 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21722e6-a15b-4e7b-b3a6-e690140277ea]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:12 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:12 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd Apr 24 19:29:12 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:13 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd" returned: 0 in 0.819s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:29:13 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Converted 1024.00 MB image at 181.90 MB/s Apr 24 19:29:13 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c is being set with open permissions: ugo+rw Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:13 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c Apr 24 19:29:13 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:13 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c" returned: 0 in 0.547s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-ffc444fb-24b7-4edd-99f8-f75aa759de1c" released by "_copy_volume_from_snapshot" :: held 8.195s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-quobyte-117b57f1-54c1-4f9a-a4e7-a474289a5281" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-117b57f1-54c1-4f9a-a4e7-a474289a5281" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Deleting offline snapshot 117b57f1-54c1-4f9a-a4e7-a474289a5281 of volume 707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] snapshot_file for this snap is: volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b47fb1-45ff-4680-864b-a029a217e1c5]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:13 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:13 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 Apr 24 19:29:13 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:14 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281" returned: 0 in 0.610s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-707f34fa-042f-41a5-8588-728357bc68bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b60505c-b2a0-4088-bd6d-ffa2cff272e8]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:14 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd Apr 24 19:29:14 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (dfe5c3e1-f6c1-4829-9cda-f2226aa6ad8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73231e71-aac4-4349-a5bb-5ee5a2b53985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73231e71-aac4-4349-a5bb-5ee5a2b53985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2061539050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21aae4fa-2a28-4ebb-b671-8e9bf629ff03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:15Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645eab9b-e0a8-4995-a7fb-b5e4e243c0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645eab9b-e0a8-4995-a7fb-b5e4e243c0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f100a938-a554-410d-aef6-20155a8a96be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f100a938-a554-410d-aef6-20155a8a96be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21aae4fa-2a28-4ebb-b671-8e9bf629ff03', 'volume_name': 'volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12300db-bf09-4873-a65c-02927d28f14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12300db-bf09-4873-a65c-02927d28f14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c132f40-748b-4a76-b6ed-eaa1e39d08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:14 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume 21aae4fa-2a28-4ebb-b671-8e9bf629ff03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03', 'volume_size': 1} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:14 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd" returned: 0 in 0.606s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:14 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:14 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 Apr 24 19:29:14 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:15 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281" returned: 0 in 0.554s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:15 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281 Apr 24 19:29:15 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:15 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd.117b57f1-54c1-4f9a-a4e7-a474289a5281" returned: 0 in 0.454s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:15 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-117b57f1-54c1-4f9a-a4e7-a474289a5281" released by "_delete_snapshot" :: held 2.316s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.053s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:15 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 14.040s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:15 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "cinder-quobyte-b8b6fabd-3ce4-42b4-9995-d16a557b147d-adf18da2-34d1-4c6e-a873-bd94601b9093" by "_create_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ee4c90-e7ca-4aa1-b821-00c4573379eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c', 'volume_size': 1, 'source_volid': '707f34fa-042f-41a5-8588-728357bc68bd', 'source_volstatus': 'available'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922f4439-b995-4ddf-ba47-0737d7c0cc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-b8b6fabd-3ce4-42b4-9995-d16a557b147d-adf18da2-34d1-4c6e-a873-bd94601b9093" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Creating volume adf18da2-34d1-4c6e-a873-bd94601b9093 from snapshot b8b6fabd-3ce4-42b4-9995-d16a557b147d {{(pid=81943) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "cinder-quobyte-adf18da2-34d1-4c6e-a873-bd94601b9093" by "_copy_volume_from_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:16 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Volume volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c (ffc444fb-24b7-4edd-99f8-f75aa759de1c): created successfully Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922f4439-b995-4ddf-ba47-0737d7c0cc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Flow 'volume_create_manager' (2dd8ad8b-a46a-4c34-8876-63fd71287e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-adf18da2-34d1-4c6e-a873-bd94601b9093" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] snapshot: b8b6fabd-3ce4-42b4-9995-d16a557b147d, volume: adf18da2-34d1-4c6e-a873-bd94601b9093, {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:16 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1d8fb320-27ad-41a3-bbc4-b64ff8702400 tempest-VolumeDependencyTests-154960378 None] Created volume successfully. Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce494c9e-4501-4e5e-9958-d2d5cb515c58]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:16 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d Apr 24 19:29:16 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-707f34fa-042f-41a5-8588-728357bc68bd-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-707f34fa-042f-41a5-8588-728357bc68bd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-quobyte-707f34fa-042f-41a5-8588-728357bc68bd" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-707f34fa-042f-41a5-8588-728357bc68bd" acquired by "delete_volume" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6371ba7-d42f-472a-bc2e-b3997a7aef52]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:16 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd Apr 24 19:29:16 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:16 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d" returned: 0 in 0.572s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3674aff-7218-48f9-a18f-e472983ef6e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Creating direct copy from snapshot {{(pid=81943) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a5a4d-a086-46d1-bcb3-e813cfd3ad78]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:16 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:16 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 Apr 24 19:29:16 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:17 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd" returned: 0 in 0.579s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:17 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd Apr 24 19:29:17 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:17 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4" returned: 0 in 0.551s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG cinder.utils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Path /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 not found in is_blk_device check {{(pid=81943) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:17 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 Apr 24 19:29:17 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:17 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-707f34fa-042f-41a5-8588-728357bc68bd" returned: 0 in 0.469s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-707f34fa-042f-41a5-8588-728357bc68bd" released by "delete_volume" :: held 1.113s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Created reservations ['15fb6166-076a-4dae-aaac-75178c3c7295', '13e00986-b061-44dc-9a54-13a7f11df4eb', 'f81bddeb-d3a8-4bae-a41a-c53608ce5d35', 'e40a6174-0d4d-45bb-b058-1e0ce62846e8'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:17 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:17 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:17 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:18 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:18 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.741s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:18 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:18 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Deleted volume successfully. Apr 24 19:29:18 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=138,cinder:UPDATE=176,cinder:INSERT=46,cinder:DELETE=12 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:29:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-181b32e6-f3ce-4d58-b865-7e56eac49763 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-707f34fa-042f-41a5-8588-728357bc68bd-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-ffc444fb-24b7-4edd-99f8-f75aa759de1c-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Lock "cinder-ffc444fb-24b7-4edd-99f8-f75aa759de1c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-quobyte-ffc444fb-24b7-4edd-99f8-f75aa759de1c" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:18 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-ffc444fb-24b7-4edd-99f8-f75aa759de1c" acquired by "delete_volume" :: waited 0.030s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:19 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7136fe-8421-40ea-aadc-675e58175416]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:19 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:19 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c Apr 24 19:29:19 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:20 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c" returned: 0 in 1.738s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:20 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:20 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c Apr 24 19:29:20 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:21 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:21 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-ffc444fb-24b7-4edd-99f8-f75aa759de1c" returned: 0 in 0.994s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:21 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-ffc444fb-24b7-4edd-99f8-f75aa759de1c" released by "delete_volume" :: held 2.856s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:21 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Created reservations ['a766a5c8-f425-4ffd-8265-360aa41b0616', '0568ec73-74b4-4592-bd59-6d6ef5b6eaa3', '741e2813-35eb-46b7-8a6c-9e873d94767b', 'b352bbd5-54e5-4534-9aff-85c9c4f18baf'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:22 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:22 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-3af65988-992c-4d4f-8a74-34764e2fdbd8-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-3af65988-992c-4d4f-8a74-34764e2fdbd8-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "cinder-quobyte-3af65988-992c-4d4f-8a74-34764e2fdbd8" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-3af65988-992c-4d4f-8a74-34764e2fdbd8" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[33175957-342e-4435-8171-f6e1efd381c5]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:22 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093" returned: 0 in 5.394s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[726447f1-3e67-4aa2-a873-52dc800ba4e3]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:22 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 Apr 24 19:29:22 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:22 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 Apr 24 19:29:22 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:22 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.675s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:22 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Deleted volume successfully. Apr 24 19:29:22 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ca8737f4-360c-4f4a-92a3-14d4390a436e tempest-VolumeDependencyTests-154960378 None] Lock "cinder-ffc444fb-24b7-4edd-99f8-f75aa759de1c-delete_volume" released by "delete_volume" :: held 4.055s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:23 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8" returned: 0 in 0.551s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:23 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8 Apr 24 19:29:23 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:23 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4" returned: 0 in 0.716s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG cinder.image.image_utils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 {{(pid=81943) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:29:23 devstack cinder-volume[81943]: INFO cinder.image.image_utils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Converted 1024.00 MB image at 189.78 MB/s Apr 24 19:29:23 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 is being set with open permissions: ugo+rw Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:23 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 Apr 24 19:29:23 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:23 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-3af65988-992c-4d4f-8a74-34764e2fdbd8" returned: 0 in 0.507s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-quobyte-3af65988-992c-4d4f-8a74-34764e2fdbd8" released by "delete_volume" :: held 1.098s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Created reservations ['a0c075f4-ae04-4e51-8feb-807d19373d78', '76b39134-5095-4122-bfed-858996183d9a', '85e84dd1-4040-45da-a2f3-6a2b9b4fe4fe', '4ebf977c-f3e2-4a1a-86ab-ed3076aab47f'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:23 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:23 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:23 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093" returned: 0 in 0.533s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-adf18da2-34d1-4c6e-a873-bd94601b9093" released by "_copy_volume_from_snapshot" :: held 7.863s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-b8b6fabd-3ce4-42b4-9995-d16a557b147d-adf18da2-34d1-4c6e-a873-bd94601b9093" released by "_create_volume_from_snapshot" :: held 7.914s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.947s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 20.723s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Creating offline snapshot 29499110-06d2-4d52-b177-e3ce9cba648a of volume f03494d0-f3ba-4922-a9c5-7ece8e06bead {{(pid=81943) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e71193-881c-4524-ae4a-eb33390037c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf18da2-34d1-4c6e-a873-bd94601b9093', 'volume_size': 1, 'snapshot_id': 'b8b6fabd-3ce4-42b4-9995-d16a557b147d'}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b017d5d-9aec-4249-8457-3d3319657d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3829cc4-052a-410b-99a5-13d45fbaaecc]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:23 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:24 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Volume volume-adf18da2-34d1-4c6e-a873-bd94601b9093 (adf18da2-34d1-4c6e-a873-bd94601b9093): created successfully Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b017d5d-9aec-4249-8457-3d3319657d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Flow 'volume_create_manager' (d21e712f-8e95-451d-8524-16b220a3a498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-aacdb7f6-a1cc-473b-87a3-db13954425f5 tempest-SnapshotDependencyTests-122296236 None] Created volume successfully. Apr 24 19:29:24 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead Apr 24 19:29:24 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:24 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.497s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:24 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Deleted volume successfully. Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-76d74be2-c0db-4196-a732-387786091425 tempest-VolumeDependencyTests-154960378 None] Lock "cinder-3af65988-992c-4d4f-8a74-34764e2fdbd8-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:24 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead" returned: 0 in 0.626s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a 1G {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:24 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a 1G Apr 24 19:29:24 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "cinder-b8b6fabd-3ce4-42b4-9995-d16a557b147d-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-b8b6fabd-3ce4-42b4-9995-d16a557b147d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "cinder-quobyte-d3674aff-7218-48f9-a18f-e472983ef6e4" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-d3674aff-7218-48f9-a18f-e472983ef6e4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "cinder-quobyte-b8b6fabd-3ce4-42b4-9995-d16a557b147d" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-b8b6fabd-3ce4-42b4-9995-d16a557b147d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Deleting offline snapshot b8b6fabd-3ce4-42b4-9995-d16a557b147d of volume d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] snapshot_file for this snap is: volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[857c8b2e-2950-4492-b302-9aef52922821]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:24 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:25 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d Apr 24 19:29:25 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:25 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a 1G" returned: 0 in 0.762s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:25 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a Apr 24 19:29:25 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:25 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d" returned: 0 in 0.680s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:25 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3674aff-7218-48f9-a18f-e472983ef6e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:29:25 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[232059f7-db56-4142-9cf5-9009d6adf029]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:25 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:25 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 Apr 24 19:29:25 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:26 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead -F qcow2 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a" returned: 0 in 0.644s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:26 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a is being set with open permissions: ugo+rw Apr 24 19:29:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:26 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a Apr 24 19:29:26 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:26 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4" returned: 0 in 0.606s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:26 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d Apr 24 19:29:26 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:26 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a" returned: 0 in 0.478s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:26 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.info Apr 24 19:29:26 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:26 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d" returned: 0 in 0.569s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:26 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:26 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d Apr 24 19:29:26 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:27 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.info" returned: 0 in 0.480s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:27 devstack cinder-volume[81943]: WARNING cinder.volume.drivers.remotefs [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.info is being set with open permissions: ugo+rw Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.info {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:27 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.info Apr 24 19:29:27 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:27 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4.b8b6fabd-3ce4-42b4-9995-d16a557b147d" returned: 0 in 0.434s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-b8b6fabd-3ce4-42b4-9995-d16a557b147d" released by "_delete_snapshot" :: held 2.408s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-d3674aff-7218-48f9-a18f-e472983ef6e4" released by "delete_snapshot" :: held 2.437s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Created reservations ['643b7651-089d-437e-9784-c253ff218402', '01580b1b-35e7-4c8c-a587-368915dd9964', 'f7ba6c3b-fb2b-45a8-8783-f1704a849c1d', '1502eff8-7a8c-4f26-92d2-9bd1bed64360'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:27 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Delete snapshot completed successfully. Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8cb2a79f-72ec-4697-846f-cc45a9887d96 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-b8b6fabd-3ce4-42b4-9995-d16a557b147d-delete_snapshot" released by "delete_snapshot" :: held 2.611s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:27 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.info" returned: 0 in 0.481s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.569s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.646s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2061539050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21aae4fa-2a28-4ebb-b671-8e9bf629ff03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:15Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Creating volume 21aae4fa-2a28-4ebb-b671-8e9bf629ff03 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:29:27 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:29:27 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:27 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03 1073741824 Apr 24 19:29:27 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:27 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-6e4f2d65-fa9d-45c6-a664-1c7818e1eab1 tempest-CinderUnicodeTest-711234343 None] Create snapshot completed successfully Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "cinder-d3674aff-7218-48f9-a18f-e472983ef6e4-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-d3674aff-7218-48f9-a18f-e472983ef6e4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "cinder-quobyte-d3674aff-7218-48f9-a18f-e472983ef6e4" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-d3674aff-7218-48f9-a18f-e472983ef6e4" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[58919050-9eab-4693-b332-a6bc5a7968db]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:28 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03 1073741824" returned: 0 in 0.663s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:28 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 Apr 24 19:29:28 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03 Apr 24 19:29:28 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:28 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Acquiring lock "cinder-29499110-06d2-4d52-b177-e3ce9cba648a-delete_snapshot" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Lock "cinder-29499110-06d2-4d52-b177-e3ce9cba648a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Acquiring lock "cinder-quobyte-f03494d0-f3ba-4922-a9c5-7ece8e06bead" by "delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Lock "cinder-quobyte-f03494d0-f3ba-4922-a9c5-7ece8e06bead" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Acquiring lock "cinder-quobyte-29499110-06d2-4d52-b177-e3ce9cba648a" by "_delete_snapshot" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Lock "cinder-quobyte-29499110-06d2-4d52-b177-e3ce9cba648a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Deleting offline snapshot 29499110-06d2-4d52-b177-e3ce9cba648a of volume f03494d0-f3ba-4922-a9c5-7ece8e06bead {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] snapshot_file for this snap is: volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a {{(pid=81943) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1604cf1-f527-4b46-bbc7-81e5adbc6448]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:28 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a Apr 24 19:29:28 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:28 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03" returned: 0 in 0.486s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:28 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4" returned: 0 in 0.546s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c132f40-748b-4a76-b6ed-eaa1e39d08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:28 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4 Apr 24 19:29:28 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0e7f4d-3953-454a-a251-b91d84935be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:28 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03 (21aae4fa-2a28-4ebb-b671-8e9bf629ff03): created successfully Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0e7f4d-3953-454a-a251-b91d84935be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:28 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (dfe5c3e1-f6c1-4829-9cda-f2226aa6ad8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:28 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-17cec838-9f79-45ca-97a5-7de5238b27ff tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created volume successfully. Apr 24 19:29:29 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a" returned: 0 in 0.517s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81943) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[1249b021-79b2-4edf-ae09-13a7df2f4f0f]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:29 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-d3674aff-7218-48f9-a18f-e472983ef6e4" returned: 0 in 0.473s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-d3674aff-7218-48f9-a18f-e472983ef6e4" released by "delete_volume" :: held 1.076s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:29 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead Apr 24 19:29:29 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Created reservations ['7c018a40-e64e-4247-b84f-2185ef71e9f4', '44243e8c-2d35-4e0e-8d2f-89bf4cc03ef6', '342069d9-0870-4455-b6cf-c7d32bec445c', '585eb8f0-99a4-4649-9b04-c209a805b0de'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:29 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:29 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:29 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead" returned: 0 in 0.507s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:29 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a Apr 24 19:29:29 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:29 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.475s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:29 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Deleted volume successfully. Apr 24 19:29:29 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-37ba7d07-1398-4a4c-8d7d-ec5d9fc02c6c tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-d3674aff-7218-48f9-a18f-e472983ef6e4-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:29:30 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (89bdfa78-bf87-4f27-9f2a-cd7166111cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e51c22-a951-4436-ac49-145530243109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a" returned: 0 in 0.628s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:30 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a Apr 24 19:29:30 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "cinder-adf18da2-34d1-4c6e-a873-bd94601b9093-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e51c22-a951-4436-ac49-145530243109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2125065254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b405006b-823d-4906-b54d-169d39bf4bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:30Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b56daf4-9aae-49f0-99da-30f66eb1478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b56daf4-9aae-49f0-99da-30f66eb1478a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64990571-ff0e-4868-9c1b-dc0081140424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64990571-ff0e-4868-9c1b-dc0081140424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b405006b-823d-4906-b54d-169d39bf4bc5', 'volume_name': 'volume-b405006b-823d-4906-b54d-169d39bf4bc5', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f6c8e9-cbf0-4c79-8c15-a9bd6acb085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f6c8e9-cbf0-4c79-8c15-a9bd6acb085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27aaf0a-8a2b-4ca8-9fbd-afa504b04e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:30 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume b405006b-823d-4906-b54d-169d39bf4bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b405006b-823d-4906-b54d-169d39bf4bc5', 'volume_size': 1} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2125065254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b405006b-823d-4906-b54d-169d39bf4bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:30Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Creating volume b405006b-823d-4906-b54d-169d39bf4bc5 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:29:30 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-adf18da2-34d1-4c6e-a873-bd94601b9093-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:30 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5 1073741824 Apr 24 19:29:30 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "cinder-quobyte-adf18da2-34d1-4c6e-a873-bd94601b9093" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-adf18da2-34d1-4c6e-a873-bd94601b9093" acquired by "delete_volume" :: waited 0.033s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[1528d6db-969c-478c-9a3c-ae977b9df1a1]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (76856a53-6569-4029-8169-416fb35e58a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:30 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 Apr 24 19:29:30 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d3c2d3-61f0-4ecd-926d-b3bd76b90568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d3c2d3-61f0-4ecd-926d-b3bd76b90568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1202701885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1d7064-563e-466d-b363-377498dcbdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:31Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229e25d6-cc23-4808-a191-9f5ff4fc30e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229e25d6-cc23-4808-a191-9f5ff4fc30e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f56d903-4563-4d76-ac14-439707d42d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f56d903-4563-4d76-ac14-439707d42d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1d7064-563e-466d-b363-377498dcbdf4', 'volume_name': 'volume-de1d7064-563e-466d-b363-377498dcbdf4', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8d2a3f-064d-4822-bff2-38f2d5e770e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8d2a3f-064d-4822-bff2-38f2d5e770e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aed554d-37a7-4dc4-b5f7-f6f497d0e512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:30 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume de1d7064-563e-466d-b363-377498dcbdf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1d7064-563e-466d-b363-377498dcbdf4', 'volume_size': 1} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:30 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead.29499110-06d2-4d52-b177-e3ce9cba648a" returned: 0 in 0.616s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:30 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Lock "cinder-quobyte-29499110-06d2-4d52-b177-e3ce9cba648a" released by "_delete_snapshot" :: held 2.400s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (497c0707-dfb4-4b6d-8435-7d05ea6fac95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47566f8-d42d-447f-9fd2-557738f93c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Lock "cinder-quobyte-f03494d0-f3ba-4922-a9c5-7ece8e06bead" released by "delete_snapshot" :: held 2.464s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47566f8-d42d-447f-9fd2-557738f93c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-511272708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9dfb790-8266-47e2-8ece-10b13c0fce27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:31Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f34eb0c-3bb4-472c-828a-023f2c3f70fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f34eb0c-3bb4-472c-828a-023f2c3f70fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e1208c-3daf-498d-be7f-140780651f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e1208c-3daf-498d-be7f-140780651f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9dfb790-8266-47e2-8ece-10b13c0fce27', 'volume_name': 'volume-a9dfb790-8266-47e2-8ece-10b13c0fce27', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2f4ee5-7724-42af-a41b-e4d067e91ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2f4ee5-7724-42af-a41b-e4d067e91ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f128228-20d1-4795-865b-d47f9066d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume a9dfb790-8266-47e2-8ece-10b13c0fce27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9dfb790-8266-47e2-8ece-10b13c0fce27', 'volume_size': 1} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Created reservations ['fbfaeaff-3b6d-4f11-9eae-aba9c475a9e7', 'dc9cd7df-c922-4299-9608-98a2b6b4eb8c', '86ac5132-faa4-45e9-bd2d-8313b5ce0ff3', 'c5d7ecb0-6a4f-4fc1-9428-6546f6ae575d'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:31 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5 1073741824" returned: 0 in 0.820s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:31 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Delete snapshot completed successfully. Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-2bf4e77b-26de-4b9f-bda5-5b97cad76b4e tempest-CinderUnicodeTest-711234343 None] Lock "cinder-29499110-06d2-4d52-b177-e3ce9cba648a-delete_snapshot" released by "delete_snapshot" :: held 2.718s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:31 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5 Apr 24 19:29:31 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:31 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093" returned: 0 in 0.764s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:31 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093 Apr 24 19:29:31 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (fd78c121-fba2-4885-bbd0-bd6d959c36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee17e9b7-7129-40ed-94ac-4c6fe2c639a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee17e9b7-7129-40ed-94ac-4c6fe2c639a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2007057633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4635c0de-6ccc-4385-8a37-fae406aa5e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:31Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e912a7f-5692-4f3d-b208-998b27a995ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e912a7f-5692-4f3d-b208-998b27a995ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b685681c-5830-49e5-b110-ce9110522328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b685681c-5830-49e5-b110-ce9110522328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4635c0de-6ccc-4385-8a37-fae406aa5e3f', 'volume_name': 'volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf11851-dce7-4b54-a960-1d8949136b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf11851-dce7-4b54-a960-1d8949136b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab18d3ed-125f-425f-bf4a-d6d7b9b82f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume 4635c0de-6ccc-4385-8a37-fae406aa5e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f', 'volume_size': 1} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81943) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (7ee99c8c-c774-4939-bd26-11105fc9083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8392ede1-d91a-4a08-9116-f4695e38df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8392ede1-d91a-4a08-9116-f4695e38df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1718966462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf2754c-020c-43b1-9a4e-9106801684a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:32Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e8064e-39cf-419a-87b8-5893ecf86f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e8064e-39cf-419a-87b8-5893ecf86f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead58fad-1d99-4471-82f7-fc7be152605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead58fad-1d99-4471-82f7-fc7be152605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf2754c-020c-43b1-9a4e-9106801684a6', 'volume_name': 'volume-9cf2754c-020c-43b1-9a4e-9106801684a6', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ed05df-42f8-402b-b1eb-a01ae4830890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ed05df-42f8-402b-b1eb-a01ae4830890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f483f676-63d9-48c0-9923-84a2fe0a30ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume 9cf2754c-020c-43b1-9a4e-9106801684a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf2754c-020c-43b1-9a4e-9106801684a6', 'volume_size': 1} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Acquiring lock "cinder-f03494d0-f3ba-4922-a9c5-7ece8e06bead-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:31 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5" returned: 0 in 0.568s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Lock "cinder-f03494d0-f3ba-4922-a9c5-7ece8e06bead-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.050s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1202701885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1d7064-563e-466d-b363-377498dcbdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:31Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Creating volume de1d7064-563e-466d-b363-377498dcbdf4 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:29:31 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:31 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27aaf0a-8a2b-4ca8-9fbd-afa504b04e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b405006b-823d-4906-b54d-169d39bf4bc5', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4 1073741824 Apr 24 19:29:31 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d588a2bf-2d05-41ab-b9b8-8f4afebc005c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-adf18da2-34d1-4c6e-a873-bd94601b9093" returned: 0 in 0.586s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:31 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume volume-b405006b-823d-4906-b54d-169d39bf4bc5 (b405006b-823d-4906-b54d-169d39bf4bc5): created successfully Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d588a2bf-2d05-41ab-b9b8-8f4afebc005c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (89bdfa78-bf87-4f27-9f2a-cd7166111cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-quobyte-adf18da2-34d1-4c6e-a873-bd94601b9093" released by "delete_volume" :: held 1.411s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:31 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-02e41e0a-483d-4922-872b-671d1ce3bbdf tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created volume successfully. Apr 24 19:29:31 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Acquiring lock "cinder-quobyte-f03494d0-f3ba-4922-a9c5-7ece8e06bead" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Lock "cinder-quobyte-f03494d0-f3ba-4922-a9c5-7ece8e06bead" acquired by "delete_volume" :: waited 0.030s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7c8910-1a29-448e-b3df-42960244c082]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Created reservations ['f3809a6e-654c-4092-8adc-65035a3af7e7', 'd24ea2fa-9e89-4cfb-8986-a3d685e2b932', '3acaf6c8-77c3-43c4-bd8c-f6d7b9a48e4b', '6cdf9f70-5d18-4b6b-beee-cf3c6f39dce2'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:32 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead Apr 24 19:29:32 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:32 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:32 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:32 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4 1073741824" returned: 0 in 0.639s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:32 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4 Apr 24 19:29:32 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:32 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.531s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:32 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Deleted volume successfully. Apr 24 19:29:32 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead" returned: 0 in 0.693s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:32 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-8669fe8e-3705-4638-a65a-c46a893bfad4 tempest-SnapshotDependencyTests-122296236 None] Lock "cinder-adf18da2-34d1-4c6e-a873-bd94601b9093-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:32 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead Apr 24 19:29:32 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:33 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4" returned: 0 in 0.591s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.018s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-511272708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9dfb790-8266-47e2-8ece-10b13c0fce27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:31Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Creating volume a9dfb790-8266-47e2-8ece-10b13c0fce27 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:29:33 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aed554d-37a7-4dc4-b5f7-f6f497d0e512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1d7064-563e-466d-b363-377498dcbdf4', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61760b58-59e7-4545-a618-cb5218c8c1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:33 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27 1073741824 Apr 24 19:29:33 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:33 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume volume-de1d7064-563e-466d-b363-377498dcbdf4 (de1d7064-563e-466d-b363-377498dcbdf4): created successfully Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61760b58-59e7-4545-a618-cb5218c8c1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (76856a53-6569-4029-8169-416fb35e58a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:33 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1983897f-95dd-43e1-a39f-3a14870b53fb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created volume successfully. Apr 24 19:29:33 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-f03494d0-f3ba-4922-a9c5-7ece8e06bead" returned: 0 in 0.489s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Lock "cinder-quobyte-f03494d0-f3ba-4922-a9c5-7ece8e06bead" released by "delete_volume" :: held 1.256s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Created reservations ['15175f64-fd61-4ca5-8c76-f025f569f03f', '246ecc35-fcfb-4ac2-aa96-90b13645e9e3', 'd66183e4-fd95-4e65-99c9-88eb07969893', '567b22ee-c94d-4a14-aec5-9a344c04323c'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:33 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:33 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:33 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.485s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:33 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Deleted volume successfully. Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-a7d50b5a-910f-4e5e-b825-2c3de0011d99 tempest-CinderUnicodeTest-711234343 None] Lock "cinder-f03494d0-f3ba-4922-a9c5-7ece8e06bead-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:33 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27 1073741824" returned: 0 in 0.775s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:33 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:34 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27 Apr 24 19:29:34 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Acquiring lock "cinder-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Lock "cinder-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Acquiring lock "cinder-quobyte-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Lock "cinder-quobyte-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf" acquired by "delete_volume" :: waited 0.014s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ce15c9-c034-4468-9c79-c927f2c693a3]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:34 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf Apr 24 19:29:34 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:34 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27" returned: 0 in 0.531s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.075s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2007057633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4635c0de-6ccc-4385-8a37-fae406aa5e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:31Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Creating volume 4635c0de-6ccc-4385-8a37-fae406aa5e3f {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:29:34 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f128228-20d1-4795-865b-d47f9066d41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9dfb790-8266-47e2-8ece-10b13c0fce27', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f86ba03-d002-4213-9bf0-0ef7f799ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:34 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f 1073741824 Apr 24 19:29:34 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:34 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume volume-a9dfb790-8266-47e2-8ece-10b13c0fce27 (a9dfb790-8266-47e2-8ece-10b13c0fce27): created successfully Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f86ba03-d002-4213-9bf0-0ef7f799ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (497c0707-dfb4-4b6d-8435-7d05ea6fac95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:34 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-9ae423dd-f4ee-44e8-85d8-fba5c2670456 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created volume successfully. Apr 24 19:29:34 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf" returned: 0 in 0.599s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:34 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:34 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf Apr 24 19:29:34 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:35 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f 1073741824" returned: 0 in 0.770s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:35 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f Apr 24 19:29:35 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:35 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf" returned: 0 in 0.658s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Lock "cinder-quobyte-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf" released by "delete_volume" :: held 1.304s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Created reservations ['15cab9d3-801a-4356-b7d0-899db2b1bd8d', '9bf6e0bc-cf8e-43b9-9ce5-f01351ff5132', '18f1f6f9-69e7-4531-925d-5dbedd66b98f', '4a3580f3-147b-4b5e-a3d4-7e6025169016'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:35 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:35 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:35 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f" returned: 0 in 0.561s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.208s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1718966462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf2754c-020c-43b1-9a4e-9106801684a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d327e6013c49491292b5e918e0759af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:29:32Z,use_quota=True,user_id='938b2bfa109e4aee9f7b4276d9ac1b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6feb1ac-0884-4c92-a31d-6c0cd743ff4a),volume_type_id=b6feb1ac-0884-4c92-a31d-6c0cd743ff4a)}" {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.remotefs [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Creating volume 9cf2754c-020c-43b1-9a4e-9106801684a6 {{(pid=81943) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Selected osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db as target Quobyte volume. {{(pid=81943) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:29:35 devstack cinder-volume[81943]: INFO cinder.volume.drivers.remotefs [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] casted to osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db Apr 24 19:29:35 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6 1073741824 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab18d3ed-125f-425f-bf4a-d6d7b9b82f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:36 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6 1073741824 Apr 24 19:29:36 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5b0b1d-6db7-4504-80e3-3fe19ad6da1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:36 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f (4635c0de-6ccc-4385-8a37-fae406aa5e3f): created successfully Apr 24 19:29:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5b0b1d-6db7-4504-80e3-3fe19ad6da1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:36 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (fd78c121-fba2-4885-bbd0-bd6d959c36e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:36 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-09d979f8-b452-496d-bb10-61ffc7cddd0b tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created volume successfully. Apr 24 19:29:36 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.554s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:36 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:36 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Deleted volume successfully. Apr 24 19:29:36 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-19e554ed-d03b-4049-8b2d-b17885fcf48f tempest-CinderUnicodeTest-711234343 None] Lock "cinder-19182a63-e1c7-4f6e-a7f9-15d58d8dd3cf-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:36 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6 1073741824" returned: 0 in 0.877s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:36 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:36 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6 Apr 24 19:29:36 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:37 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6" returned: 0 in 0.588s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:37 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'} {{(pid=81943) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:29:37 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f483f676-63d9-48c0-9923-84a2fe0a30ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf2754c-020c-43b1-9a4e-9106801684a6', 'volume_size': 1}' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35a4bc5-c846-46e7-982b-7d7f7af6635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:29:37 devstack cinder-volume[81943]: INFO cinder.volume.flows.manager.create_volume [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Volume volume-9cf2754c-020c-43b1-9a4e-9106801684a6 (9cf2754c-020c-43b1-9a4e-9106801684a6): created successfully Apr 24 19:29:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35a4bc5-c846-46e7-982b-7d7f7af6635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81943) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:29:37 devstack cinder-volume[81943]: DEBUG cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Flow 'volume_create_manager' (7ee99c8c-c774-4939-bd26-11105fc9083b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81943) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:29:37 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1afd0e8c-e554-40da-b769-0d67f8ea44cb tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created volume successfully. Apr 24 19:29:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-9cf2754c-020c-43b1-9a4e-9106801684a6-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-9cf2754c-020c-43b1-9a4e-9106801684a6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-quobyte-9cf2754c-020c-43b1-9a4e-9106801684a6" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:38 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-9cf2754c-020c-43b1-9a4e-9106801684a6" acquired by "delete_volume" :: waited 0.021s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:38 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8e3359-f9fb-42d0-aa87-f99195a1beed]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:38 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:38 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6 Apr 24 19:29:38 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:39 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6" returned: 0 in 0.589s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:39 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6 Apr 24 19:29:39 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:39 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-9cf2754c-020c-43b1-9a4e-9106801684a6" returned: 0 in 0.511s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-9cf2754c-020c-43b1-9a4e-9106801684a6" released by "delete_volume" :: held 1.152s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created reservations ['958f2da9-ed39-47f6-8606-75eb22abfa26', '56cf5681-14f1-4868-8594-150e69f1471a', 'ea91eca9-59f2-4bff-a0b8-64248df598f4', '111dbd1d-7510-4865-9e9f-6e22e26ce3bf'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:39 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:39 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:39 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:40 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.503s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:40 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Deleted volume successfully. Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-53912bab-f11c-4c6a-bab1-2153a7d6583d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-9cf2754c-020c-43b1-9a4e-9106801684a6-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-4635c0de-6ccc-4385-8a37-fae406aa5e3f-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-4635c0de-6ccc-4385-8a37-fae406aa5e3f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-quobyte-4635c0de-6ccc-4385-8a37-fae406aa5e3f" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-4635c0de-6ccc-4385-8a37-fae406aa5e3f" acquired by "delete_volume" :: waited 0.022s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[8744c32d-ff75-4a63-97c2-f419210d1783]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG oslo_service.periodic_task [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81943) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:40 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f Apr 24 19:29:40 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:40 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:40 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:40 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:41 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f" returned: 0 in 0.515s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:41 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f Apr 24 19:29:41 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:41 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.539s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:41 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-9a55bb43-59d7-472a-a64c-ce87d5f7acba None None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:41 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:41 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-4635c0de-6ccc-4385-8a37-fae406aa5e3f" returned: 0 in 0.457s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:41 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-4635c0de-6ccc-4385-8a37-fae406aa5e3f" released by "delete_volume" :: held 1.021s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:41 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created reservations ['351751d0-f023-40d3-a70f-fb62a4879430', 'd0a1b538-3dbe-4497-a564-0ac6a37ab396', '3f14cd10-45eb-4876-bb85-18184c71e76b', 'ca941c73-7d07-4e2c-9ded-9fb8d478b9af'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:42 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:42 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:42 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:42 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:42 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.461s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:42 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:42 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Deleted volume successfully. Apr 24 19:29:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-00d96bd8-20d9-4ee1-aca3-cfca8316c586 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-4635c0de-6ccc-4385-8a37-fae406aa5e3f-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:42 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-a9dfb790-8266-47e2-8ece-10b13c0fce27-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-a9dfb790-8266-47e2-8ece-10b13c0fce27-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-quobyte-a9dfb790-8266-47e2-8ece-10b13c0fce27" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:43 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-a9dfb790-8266-47e2-8ece-10b13c0fce27" acquired by "delete_volume" :: waited 0.019s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:43 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd29b23a-8d79-4784-b28b-0a973c2407b8]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:43 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27 Apr 24 19:29:43 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:43 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27" returned: 0 in 0.529s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:43 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:43 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27 Apr 24 19:29:43 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:44 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-a9dfb790-8266-47e2-8ece-10b13c0fce27" returned: 0 in 0.422s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-a9dfb790-8266-47e2-8ece-10b13c0fce27" released by "delete_volume" :: held 0.993s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created reservations ['6410e476-2eae-42a6-9c9d-f5cb6ba731b2', '9f89c188-accf-48a6-b712-00731eb91d93', 'ecc26310-1609-4255-b560-db84d4a2e6aa', 'f2dc61c4-3c4d-4b38-af03-8a724bd8c993'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:44 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:44 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:44 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.434s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:44 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Deleted volume successfully. Apr 24 19:29:44 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-26f0f742-71ff-44a1-a787-2a59b51d161f tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-a9dfb790-8266-47e2-8ece-10b13c0fce27-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-de1d7064-563e-466d-b363-377498dcbdf4-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-de1d7064-563e-466d-b363-377498dcbdf4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-quobyte-de1d7064-563e-466d-b363-377498dcbdf4" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:45 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-de1d7064-563e-466d-b363-377498dcbdf4" acquired by "delete_volume" :: waited 0.026s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:45 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c52f31-ef34-411e-8eae-5310f16d7a71]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:45 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4 Apr 24 19:29:45 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:45 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4" returned: 0 in 0.495s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:45 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:45 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4 Apr 24 19:29:45 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:46 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-de1d7064-563e-466d-b363-377498dcbdf4" returned: 0 in 0.464s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-de1d7064-563e-466d-b363-377498dcbdf4" released by "delete_volume" :: held 0.999s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created reservations ['6fcff48a-a388-46b5-9544-8ebb1caf2bcf', '1501bff2-6520-4a68-a223-261e18be35bd', '07fb2c04-0994-421e-bfdf-ef3716a7bd88', '74ed5568-19bc-4780-8396-38e8758f5345'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:46 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:46 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:46 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.469s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:46 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Deleted volume successfully. Apr 24 19:29:46 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-649e7776-5f26-4f31-b7d6-509c9813743d tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-de1d7064-563e-466d-b363-377498dcbdf4-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-b405006b-823d-4906-b54d-169d39bf4bc5-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-b405006b-823d-4906-b54d-169d39bf4bc5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-quobyte-b405006b-823d-4906-b54d-169d39bf4bc5" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:47 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-b405006b-823d-4906-b54d-169d39bf4bc5" acquired by "delete_volume" :: waited 0.015s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:47 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82717b8-311e-41fb-9068-e8b5f2f964bd]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:47 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:47 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5 Apr 24 19:29:47 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:48 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5" returned: 0 in 0.501s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:48 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5 Apr 24 19:29:48 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:48 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-b405006b-823d-4906-b54d-169d39bf4bc5" returned: 0 in 0.441s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-b405006b-823d-4906-b54d-169d39bf4bc5" released by "delete_volume" :: held 0.992s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created reservations ['6f287b85-d748-4e40-b64b-3ec3f485dd43', '143ba7f5-a481-46b7-8874-f1af042c6567', 'f2afbf96-813c-4510-965c-53e1c727f4bb', '3ea0b42f-0d4e-4274-847f-fe75ce3da28f'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:48 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:48 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:48 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:49 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.470s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:49 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:49 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Deleted volume successfully. Apr 24 19:29:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-1b1074a5-7d84-4fbe-bf36-d647cd483da1 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-b405006b-823d-4906-b54d-169d39bf4bc5-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-21aae4fa-2a28-4ebb-b671-8e9bf629ff03-delete_volume" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-21aae4fa-2a28-4ebb-b671-8e9bf629ff03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "cinder-quobyte-21aae4fa-2a28-4ebb-b671-8e9bf629ff03" by "delete_volume" {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:29:49 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-21aae4fa-2a28-4ebb-b671-8e9bf629ff03" acquired by "delete_volume" :: waited 0.020s {{(pid=81943) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:29:49 devstack cinder-volume[81943]: DEBUG oslo.privsep.daemon [-] privsep: reply[f326fc65-87c6-4975-b7c1-f36f9a3f9bdc]: (4, 'qcow2') {{(pid=82613) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:29:49 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:49 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03 Apr 24 19:29:49 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:50 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03" returned: 0 in 0.552s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:50 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03 Apr 24 19:29:50 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:50 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4/volume-21aae4fa-2a28-4ebb-b671-8e9bf629ff03" returned: 0 in 0.465s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-quobyte-21aae4fa-2a28-4ebb-b671-8e9bf629ff03" released by "delete_volume" :: held 1.063s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG cinder.quota [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Created reservations ['f9db2cbe-844c-4a86-bb46-a2a50ef86dc7', 'fa73533f-c4fe-4f83-8393-a6599f1572d3', '1b410c93-0055-442b-bc8a-ce6279cd58c7', '966de586-68dc-4f92-9b6c-b31e6875be3e'] {{(pid=81943) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db': None} {{(pid=81943) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG cinder.volume.drivers.quobyte [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7046f5d4-fe67-4f8d-9677-74e50fd334db'] {{(pid=81943) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.lockutils [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81943) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:29:50 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:29:51 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4 Apr 24 19:29:51 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:29:51 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Apr 24 19:29:51 devstack cinder-volume[81943]: DEBUG oslo_concurrency.processutils [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e22b09983483e28571567362b9a3de4" returned: 0 in 0.447s {{(pid=81943) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:29:51 devstack cinder-volume[81943]: DEBUG cinder.manager [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Notifying Schedulers of capabilities ... {{(pid=81943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:29:51 devstack cinder-volume[81943]: INFO cinder.volume.manager [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Deleted volume successfully. Apr 24 19:29:51 devstack cinder-volume[81943]: DEBUG cinder.coordination [None req-ddb6fab4-7d09-430f-afd5-9c737bb83c98 tempest-CreateVolumesFromSourceVolumeTest-890532997 None] Lock "cinder-21aae4fa-2a28-4ebb-b671-8e9bf629ff03-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=81943) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:30:00 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:SELECT=88,cinder:UPDATE=120,cinder:DELETE=11,cinder:INSERT=26 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:30:01 devstack cinder-volume[81943]: DEBUG dbcounter [-] [81943] Writing DB stats cinder:INSERT=55,cinder:UPDATE=223,cinder:SELECT=142,cinder:DELETE=18 {{(pid=81943) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}